Aug 15 21:08:54 user nova-compute[72992]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 21:08:57 user nova-compute[72992]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72992) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72992) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72992) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 21:08:57 user nova-compute[72992]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:08:57 user nova-compute[72992]: INFO nova.virt.driver [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 21:08:57 user nova-compute[72992]: INFO nova.compute.provider_config [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Acquiring lock "singleton_lock" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Acquired lock "singleton_lock" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Releasing lock "singleton_lock" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Full set of CONF: {{(pid=72992) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ******************************************************************************** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Configuration options gathered from: {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ================================================================================ {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] allow_resize_to_same_host      = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] arq_binding_timeout            = 300 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] backdoor_port                  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] backdoor_socket                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] block_device_allocate_retries  = 300 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] block_device_allocate_retries_interval = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cert                           = self.pem {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute_monitors               = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] config_dir                     = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] config_drive_format            = iso9660 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] config_source                  = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] console_host                   = user {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] control_exchange               = nova {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cpu_allocation_ratio           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] daemon                         = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] debug                          = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] default_access_ip_network_name = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] default_availability_zone      = nova {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] default_ephemeral_format       = ext4 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] default_schedule_zone          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] disk_allocation_ratio          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] enable_new_services            = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] enabled_ssl_apis               = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] flat_injected                  = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] force_config_drive             = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] force_raw_images               = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] graceful_shutdown_timeout      = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] heal_instance_info_cache_interval = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] host                           = user {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instance_build_timeout         = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instance_delete_interval       = 300 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instance_name_template         = instance-%08x {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instance_usage_audit           = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instance_usage_audit_period    = month {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] internal_service_availability_zone = internal {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] key                            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] live_migration_retry_count     = 30 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_config_append              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_dir                        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_file                       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_options                    = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_rotate_interval            = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_rotate_interval_type       = days {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] log_rotation_type              = none {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] long_rpc_timeout               = 1800 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] max_concurrent_builds          = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] max_concurrent_live_migrations = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] max_concurrent_snapshots       = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] max_local_block_devices        = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] max_logfile_count              = 30 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] max_logfile_size_mb            = 200 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] maximum_instance_delete_attempts = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] metadata_listen                = 0.0.0.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] metadata_listen_port           = 8775 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] metadata_workers               = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] migrate_max_retries            = -1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] mkisofs_cmd                    = genisoimage {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:57 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] my_ip                          = 10.0.0.210 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] network_allocate_retries       = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] osapi_compute_listen_port      = 8774 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] osapi_compute_unique_server_name_scope =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] osapi_compute_workers          = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] password_length                = 12 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] periodic_enable                = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] periodic_fuzzy_delay           = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] pointer_model                  = ps2mouse {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] preallocate_images             = none {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] publish_errors                 = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] pybasedir                      = /opt/stack/nova {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ram_allocation_ratio           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rate_limit_burst               = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rate_limit_except_level        = CRITICAL {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rate_limit_interval            = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] reboot_timeout                 = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] reclaim_instance_interval      = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] record                         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] reimage_timeout_per_gb         = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] report_interval                = 120 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rescue_timeout                 = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] reserved_host_cpus             = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] reserved_host_disk_mb          = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] reserved_host_memory_mb        = 512 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] reserved_huge_pages            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] resize_confirm_window          = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] resize_fs_using_block_device   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] resume_guests_state_on_host_boot = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rpc_response_timeout           = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] run_external_periodic_tasks    = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] running_deleted_instance_action = reap {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] running_deleted_instance_timeout = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler_instance_sync_interval = 120 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_down_time              = 720 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] servicegroup_driver            = db {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] shelved_offload_time           = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] shelved_poll_interval          = 3600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] shutdown_timeout               = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] source_is_ipv6                 = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ssl_only                       = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] state_path                     = /opt/stack/data/nova {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] sync_power_state_interval      = 600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] sync_power_state_pool_size     = 1000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] syslog_log_facility            = LOG_USER {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] tempdir                        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] timeout_nbd                    = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] transport_url                  = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] update_resources_interval      = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] use_cow_images                 = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] use_eventlog                   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] use_journal                    = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] use_json                       = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] use_rootwrap_daemon            = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] use_stderr                     = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] use_syslog                     = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vcpu_pin_set                   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plugging_is_fatal          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plugging_timeout           = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] virt_mkfs                      = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] volume_usage_poll_interval     = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] watch_log_file                 = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] web                            = /usr/share/spice-html5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.auth_strategy              = keystone {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.compute_link_prefix        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.dhcp_domain                = novalocal {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.enable_instance_password   = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.glance_link_prefix         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.instance_list_per_project_cells = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.list_records_by_skipping_down_cells = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.local_metadata_per_cell    = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.max_limit                  = 1000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.metadata_cache_expiration  = 15 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.neutron_default_tenant_id  = default {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.use_forwarded_for          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.use_neutron_default_nets   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.vendordata_dynamic_targets = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.vendordata_jsonfile_path   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.backend_argument         = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.config_prefix            = cache.oslo {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.dead_timeout             = 60.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.debug_cache_backend      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.enable_retry_client      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.enable_socket_keepalive  = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.enabled                  = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.expiration_time          = 600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_dead_retry      = 300 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_password        =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_sasl_enabled    = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.memcache_username        =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.proxies                  = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.retry_attempts           = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.retry_delay              = 0.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.socket_keepalive_count   = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.socket_keepalive_idle    = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.socket_keepalive_interval = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.tls_allowed_ciphers      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.tls_cafile               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.tls_certfile             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.tls_enabled              = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cache.tls_keyfile              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.auth_section            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.auth_type               = password {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.cafile                  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.certfile                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.collect_timing          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.cross_az_attach         = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.debug                   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.endpoint_template       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.http_retries            = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.insecure                = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.keyfile                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.os_region_name          = RegionOne {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.split_loggers           = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cinder.timeout                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.cpu_dedicated_set      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.cpu_shared_set         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.image_type_exclude_list = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.resource_provider_association_refresh = 300 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.shutdown_retry_interval = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] conductor.workers              = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] console.allowed_origins        = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] console.ssl_ciphers            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] console.ssl_minimum_version    = default {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] consoleauth.token_ttl          = 600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.cafile                  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.certfile                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.collect_timing          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.connect_retries         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.connect_retry_delay     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.endpoint_override       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.insecure                = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.keyfile                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.max_version             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.min_version             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.region_name             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.service_name            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.service_type            = accelerator {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.split_loggers           = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.status_code_retries     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.status_code_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.timeout                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] cyborg.version                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.backend               = sqlalchemy {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.connection            = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.connection_debug      = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.connection_parameters =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.connection_recycle_time = 3600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.connection_trace      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.db_inc_retry_interval = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.db_max_retries        = 20 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.db_max_retry_interval = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.db_retry_interval     = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.max_overflow          = 50 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.max_pool_size         = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.max_retries           = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.mysql_enable_ndb      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.pool_timeout          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.retry_interval        = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.slave_connection      = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] database.sqlite_synchronous    = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.backend           = sqlalchemy {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.connection        = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.connection_debug  = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.connection_parameters =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.connection_recycle_time = 3600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.connection_trace  = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.db_inc_retry_interval = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.db_max_retries    = 20 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.db_max_retry_interval = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.db_retry_interval = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.max_overflow      = 50 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.max_pool_size     = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.max_retries       = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.mysql_enable_ndb  = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.pool_timeout      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.retry_interval    = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.slave_connection  = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] api_database.sqlite_synchronous = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] devices.enabled_mdev_types     = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ephemeral_storage_encryption.enabled = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.api_servers             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.cafile                  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.certfile                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.collect_timing          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.connect_retries         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.connect_retry_delay     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.debug                   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.default_trusted_certificate_ids = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.enable_certificate_validation = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.enable_rbd_download     = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.endpoint_override       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.insecure                = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.keyfile                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.max_version             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.min_version             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.num_retries             = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.rbd_ceph_conf           =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.rbd_connect_timeout     = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.rbd_pool                =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.rbd_user                =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.region_name             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.service_name            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.service_type            = image {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.split_loggers           = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.status_code_retries     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.status_code_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.timeout                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.verify_glance_signatures = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] glance.version                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] guestfs.debug                  = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.config_drive_cdrom      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.config_drive_inject_password = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.enable_remotefx         = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.instances_path_share    =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.limit_cpu_features      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.use_multipath_io        = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.vswitch_name            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] mks.enabled                    = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] image_cache.manager_interval   = 2400 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] image_cache.precache_concurrency = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] image_cache.remove_unused_base_images = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] image_cache.subdirectory_name  = _base {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.api_max_retries         = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.api_retry_interval      = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.auth_section            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.auth_type               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.cafile                  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.certfile                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.collect_timing          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.connect_retries         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.connect_retry_delay     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.endpoint_override       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.insecure                = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.keyfile                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.max_version             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.min_version             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.partition_key           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.peer_list               = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.region_name             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.serial_console_state_timeout = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.service_name            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.service_type            = baremetal {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.split_loggers           = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.status_code_retries     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.status_code_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.timeout                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ironic.version                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] key_manager.fixed_key          = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.barbican_api_version  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.barbican_endpoint     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.barbican_endpoint_type = public {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.barbican_region_name  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.cafile                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.certfile              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.collect_timing        = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.insecure              = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.keyfile               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.number_of_retries     = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.retry_delay           = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.send_service_user_token = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.split_loggers         = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.timeout               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.verify_ssl            = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican.verify_ssl_path       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.auth_section = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.auth_type = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.cafile   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.certfile = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.collect_timing = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.insecure = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.keyfile  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.split_loggers = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] barbican_service_user.timeout  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.approle_role_id          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.approle_secret_id        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.cafile                   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.certfile                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.collect_timing           = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.insecure                 = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.keyfile                  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.kv_mountpoint            = secret {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.kv_version               = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.namespace                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.root_token_id            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.split_loggers            = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.ssl_ca_crt_file          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.timeout                  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.use_ssl                  = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.cafile                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.certfile              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.collect_timing        = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.connect_retries       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.connect_retry_delay   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.endpoint_override     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.insecure              = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.keyfile               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.max_version           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.min_version           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.region_name           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.service_name          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.service_type          = identity {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.split_loggers         = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.status_code_retries   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.status_code_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.timeout               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] keystone.version               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.connection_uri         =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.cpu_mode               = custom {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: WARNING oslo_config.cfg [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.cpu_power_governor_high = performance {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.cpu_power_management   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.device_detach_attempts = 8 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.device_detach_timeout  = 20 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.disk_cachemodes        = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.disk_prefix            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.enabled_perf_events    = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.file_backed_memory     = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.gid_maps               = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.hw_disk_discard        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.hw_machine_type        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.images_rbd_pool        = rbd {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.images_type            = default {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.images_volume_group    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.inject_key             = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.inject_partition       = -2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.inject_password        = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.iscsi_iface            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.iser_use_multipath     = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_downtime = 500 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_inbound_addr = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_scheme  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_timeout_action = abort {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_tunnelled = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: WARNING oslo_config.cfg [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 21:08:58 user nova-compute[72992]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 21:08:58 user nova-compute[72992]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 21:08:58 user nova-compute[72992]: and ``live_migration_inbound_addr`` respectively.
Aug 15 21:08:58 user nova-compute[72992]: ).  Its value may be silently ignored in the future.
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.live_migration_with_native_tls = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.max_queues             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.nfs_mount_options      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.num_pcie_ports         = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.pmem_namespaces        = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.quobyte_client_cfg     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rbd_secret_uuid        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rbd_user               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rescue_image_id        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rescue_kernel_id       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.rx_queue_size          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.smbfs_mount_options    =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.snapshot_compression   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.snapshot_image_format  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.sparse_logical_volumes = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.swtpm_enabled          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.swtpm_group            = tss {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.swtpm_user             = tss {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.sysinfo_serial         = unique {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.tb_cache_size          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.tx_queue_size          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.uid_maps               = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.use_virtio_for_bridges = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.virt_type              = kvm {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.volume_clear           = zero {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.volume_clear_size      = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.volume_use_multipath   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.vzstorage_cache_path   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.auth_section           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.auth_type              = password {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.cafile                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.certfile               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.collect_timing         = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.connect_retries        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.connect_retry_delay    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.default_floating_pool  = public {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.endpoint_override      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.extension_sync_interval = 600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.http_retries           = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.insecure               = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.keyfile                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.max_version            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.min_version            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.ovs_bridge             = br-int {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.physnets               = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.region_name            = RegionOne {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.service_metadata_proxy = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.service_name           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.service_type           = network {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.split_loggers          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.status_code_retries    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.status_code_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.timeout                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] neutron.version                = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] notifications.bdms_in_notifications = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] notifications.default_level    = INFO {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] notifications.notification_format = unversioned {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] notifications.notify_on_state_change = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] pci.alias                      = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] pci.device_spec                = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] pci.report_in_placement        = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.auth_section         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.auth_type            = password {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.cafile               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.certfile             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.collect_timing       = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.connect_retries      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.connect_retry_delay  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.default_domain_id    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.default_domain_name  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.domain_id            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.domain_name          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.endpoint_override    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.insecure             = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.keyfile              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.max_version          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.min_version          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.password             = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.project_domain_id    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.project_domain_name  = Default {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.project_id           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.project_name         = service {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.region_name          = RegionOne {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.service_name         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.service_type         = placement {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.split_loggers        = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.status_code_retries  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.status_code_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.system_scope         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.timeout              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.trust_id             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.user_domain_id       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.user_domain_name     = Default {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.user_id              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.username             = placement {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] placement.version              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.cores                    = 20 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.count_usage_from_placement = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.injected_file_content_bytes = 10240 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.injected_file_path_length = 255 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.injected_files           = 5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.instances                = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.key_pairs                = 100 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.metadata_items           = 128 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.ram                      = 51200 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.recheck_quota            = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.server_group_members     = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] quota.server_groups            = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rdp.enabled                    = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.image_metadata_prefilter = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.max_attempts         = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.max_placement_results = 1000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] scheduler.workers              = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.host_subset_size = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.isolated_hosts = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.isolated_images = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.pci_in_placement = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.track_instance_changes = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] metrics.required               = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] metrics.weight_multiplier      = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] metrics.weight_setting         = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] serial_console.enabled         = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] serial_console.port_range      = 10000:20000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] serial_console.serialproxy_port = 6083 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.auth_section      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.auth_type         = password {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.cafile            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.certfile          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.collect_timing    = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.insecure          = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.keyfile           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.send_service_user_token = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.split_loggers     = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] service_user.timeout           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.agent_enabled            = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.enabled                  = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.html5proxy_port          = 6082 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.image_compression        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.jpeg_compression         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.playback_compression     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.server_listen            = 127.0.0.1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.streaming_mode           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] spice.zlib_compression         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] upgrade_levels.baseapi         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] upgrade_levels.cert            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] upgrade_levels.compute         = auto {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] upgrade_levels.conductor       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] upgrade_levels.scheduler       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.cafile = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.certfile = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.insecure = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vendordata_dynamic_auth.timeout = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.api_retry_count         = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.ca_file                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.cache_prefix            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.cluster_name            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.connection_pool_size    = 10 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.console_delay_seconds   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.datastore_regex         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.host_ip                 = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.host_password           = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.host_port               = 443 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.host_username           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.insecure                = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.integration_bridge      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.maximum_objects         = 100 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.pbm_default_policy      = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.pbm_enabled             = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.pbm_wsdl_location       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.serial_port_proxy_uri   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.serial_port_service_uri = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.task_poll_interval      = 0.5 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.use_linked_clone        = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.vnc_keymap              = en-us {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.vnc_port                = 5900 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vmware.vnc_port_total          = 10000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.auth_schemes               = ['none'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.enabled                    = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.novncproxy_port            = 6080 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.vencrypt_ca_certs          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.vencrypt_client_cert       = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vnc.vencrypt_client_key        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.disable_rootwrap   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.enable_numa_live_migration = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.libvirt_disable_apic = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.client_socket_timeout     = 900 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.default_pool_size         = 1000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.keep_alive                = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.max_header_line           = 16384 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.ssl_ca_file               = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.ssl_cert_file             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.ssl_key_file              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.tcp_keepidle              = 600 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] zvm.ca_file                    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] zvm.cloud_connector_url        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] zvm.reachable_timeout          = 300 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.enforce_scope      = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.policy_default_rule = default {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.connection_string     = messaging:// {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.enabled               = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.es_doc_type           = notification {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.es_scroll_size        = 10000 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.es_scroll_time        = 2m {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.filter_error_trace    = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.hmac_keys             = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.sentinel_service_name = mymaster {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.socket_timeout        = 0.1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.trace_requests        = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler.trace_sqlalchemy      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler_jaeger.process_tags   = {} {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] profiler_otlp.service_name_prefix = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] remote_debug.host              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] remote_debug.port              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.auth_section        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.auth_type           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.cafile              = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.certfile            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.collect_timing      = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.connect_retries     = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.connect_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.endpoint_id         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.endpoint_override   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.insecure            = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.keyfile             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.max_version         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.min_version         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.region_name         = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.service_name        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.service_type        = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.split_loggers       = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.status_code_retries = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.status_code_retry_delay = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.timeout             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.valid_interfaces    = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_limit.version             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_reports.file_event_handler = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] oslo_reports.log_dir           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_ovs_privileged.group  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] vif_plug_ovs_privileged.user   = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_ovs.isolate_vif         = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] os_brick.lock_path             = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] privsep_osbrick.capabilities   = [21] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] privsep_osbrick.group          = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] privsep_osbrick.helper_command = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] privsep_osbrick.user           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] nova_sys_admin.group           = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] nova_sys_admin.helper_command  = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] nova_sys_admin.user            = None {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG oslo_service.service [None req-dc4caac5-2f5d-4006-9a00-aa74aeb543c1 None None] ******************************************************************************** {{(pid=72992) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 21:08:58 user nova-compute[72992]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 21:08:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Starting native event thread {{(pid=72992) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Starting green dispatch thread {{(pid=72992) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Starting connection event dispatch thread {{(pid=72992) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Connecting to libvirt: qemu:///system {{(pid=72992) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0cac6c4d30> {{(pid=72992) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 21:08:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0cac6c4d30> {{(pid=72992) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 21:08:58 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Connection event '1' reason 'None'
Aug 15 21:08:58 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 21:08:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.mount [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Initialising _HostMountState generation 0 {{(pid=72992) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 21:09:05 user nova-compute[72992]: INFO nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host capabilities <capabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <host>
Aug 15 21:09:05 user nova-compute[72992]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 21:09:05 user nova-compute[72992]:     <cpu>
Aug 15 21:09:05 user nova-compute[72992]:       <arch>x86_64</arch>
Aug 15 21:09:05 user nova-compute[72992]:       <model>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <microcode version='1070'/>
Aug 15 21:09:05 user nova-compute[72992]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 21:09:05 user nova-compute[72992]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='osxsave'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='invtsc'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='rsba'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 21:09:05 user nova-compute[72992]:       <pages unit='KiB' size='4'/>
Aug 15 21:09:05 user nova-compute[72992]:       <pages unit='KiB' size='2048'/>
Aug 15 21:09:05 user nova-compute[72992]:     </cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <power_management>
Aug 15 21:09:05 user nova-compute[72992]:       <suspend_mem/>
Aug 15 21:09:05 user nova-compute[72992]:       <suspend_disk/>
Aug 15 21:09:05 user nova-compute[72992]:       <suspend_hybrid/>
Aug 15 21:09:05 user nova-compute[72992]:     </power_management>
Aug 15 21:09:05 user nova-compute[72992]:     <iommu support='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <migration_features>
Aug 15 21:09:05 user nova-compute[72992]:       <live/>
Aug 15 21:09:05 user nova-compute[72992]:       <uri_transports>
Aug 15 21:09:05 user nova-compute[72992]:         <uri_transport>tcp</uri_transport>
Aug 15 21:09:05 user nova-compute[72992]:         <uri_transport>rdma</uri_transport>
Aug 15 21:09:05 user nova-compute[72992]:       </uri_transports>
Aug 15 21:09:05 user nova-compute[72992]:     </migration_features>
Aug 15 21:09:05 user nova-compute[72992]:     <topology>
Aug 15 21:09:05 user nova-compute[72992]:       <cells num='2'>
Aug 15 21:09:05 user nova-compute[72992]:         <cell id='0'>
Aug 15 21:09:05 user nova-compute[72992]:           <memory unit='KiB'>8189224</memory>
Aug 15 21:09:05 user nova-compute[72992]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 15 21:09:05 user nova-compute[72992]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 21:09:05 user nova-compute[72992]:           <distances>
Aug 15 21:09:05 user nova-compute[72992]:             <sibling id='0' value='10'/>
Aug 15 21:09:05 user nova-compute[72992]:             <sibling id='1' value='20'/>
Aug 15 21:09:05 user nova-compute[72992]:           </distances>
Aug 15 21:09:05 user nova-compute[72992]:           <cpus num='6'>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 21:09:05 user nova-compute[72992]:           </cpus>
Aug 15 21:09:05 user nova-compute[72992]:         </cell>
Aug 15 21:09:05 user nova-compute[72992]:         <cell id='1'>
Aug 15 21:09:05 user nova-compute[72992]:           <memory unit='KiB'>8206460</memory>
Aug 15 21:09:05 user nova-compute[72992]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 15 21:09:05 user nova-compute[72992]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 21:09:05 user nova-compute[72992]:           <distances>
Aug 15 21:09:05 user nova-compute[72992]:             <sibling id='0' value='20'/>
Aug 15 21:09:05 user nova-compute[72992]:             <sibling id='1' value='10'/>
Aug 15 21:09:05 user nova-compute[72992]:           </distances>
Aug 15 21:09:05 user nova-compute[72992]:           <cpus num='6'>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 21:09:05 user nova-compute[72992]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 21:09:05 user nova-compute[72992]:           </cpus>
Aug 15 21:09:05 user nova-compute[72992]:         </cell>
Aug 15 21:09:05 user nova-compute[72992]:       </cells>
Aug 15 21:09:05 user nova-compute[72992]:     </topology>
Aug 15 21:09:05 user nova-compute[72992]:     <cache>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 21:09:05 user nova-compute[72992]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 21:09:05 user nova-compute[72992]:     </cache>
Aug 15 21:09:05 user nova-compute[72992]:     <secmodel>
Aug 15 21:09:05 user nova-compute[72992]:       <model>apparmor</model>
Aug 15 21:09:05 user nova-compute[72992]:       <doi>0</doi>
Aug 15 21:09:05 user nova-compute[72992]:     </secmodel>
Aug 15 21:09:05 user nova-compute[72992]:     <secmodel>
Aug 15 21:09:05 user nova-compute[72992]:       <model>dac</model>
Aug 15 21:09:05 user nova-compute[72992]:       <doi>0</doi>
Aug 15 21:09:05 user nova-compute[72992]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 21:09:05 user nova-compute[72992]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 21:09:05 user nova-compute[72992]:     </secmodel>
Aug 15 21:09:05 user nova-compute[72992]:   </host>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='alpha'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>clipper</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='armv6l'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>spitz</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>nuri</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>kzm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sx1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>z2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>tosa</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>n810</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>n800</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>terrier</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>midway</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>microbit</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>verdex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>highbank</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>akita</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>connex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>collie</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='armv7l'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>spitz</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>nuri</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>kzm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sx1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>z2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>tosa</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>n810</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>n800</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>terrier</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>midway</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>microbit</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>verdex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>highbank</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>akita</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>connex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>collie</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='aarch64'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>spitz</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>nuri</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>kzm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sx1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>z2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>tosa</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>n810</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>n800</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>terrier</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>midway</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>microbit</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>verdex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>highbank</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>akita</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>connex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>collie</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <acpi default='on' toggle='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='cris'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='i686'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>isapc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>microvm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='kvm'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <pae/>
Aug 15 21:09:05 user nova-compute[72992]:       <nonpae/>
Aug 15 21:09:05 user nova-compute[72992]:       <acpi default='on' toggle='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:       <apic default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='m68k'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>an5206</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>q800</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='microblaze'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='microblazeel'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='mips'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='16'>malta</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='mipsel'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='16'>malta</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='mips64'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='16'>malta</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>pica61</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>magnum</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='mips64el'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='16'>malta</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>pica61</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>magnum</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='16'>boston</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='ppc'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mac99</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>40p</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>taihu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='ppc64'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>taihu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>40p</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mac99</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='ppc64le'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>taihu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>40p</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>mac99</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='riscv32'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='8'>spike</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='8'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='riscv64'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='8'>spike</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='8'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='s390x'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='sh4'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>shix</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>r2d</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='sh4eb'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>shix</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>r2d</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='sparc'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>LX</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='sparc64'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>niagara</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='x86_64'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>64</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='1'>isapc</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>microvm</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='kvm'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <acpi default='on' toggle='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:       <apic default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='xtensa'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>sim</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>kc705</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>ml605</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx200</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx60</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]:   <guest>
Aug 15 21:09:05 user nova-compute[72992]:     <os_type>hvm</os_type>
Aug 15 21:09:05 user nova-compute[72992]:     <arch name='xtensaeb'>
Aug 15 21:09:05 user nova-compute[72992]:       <wordsize>32</wordsize>
Aug 15 21:09:05 user nova-compute[72992]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='4'>sim</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>kc705</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>ml605</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>virt</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx200</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>lx60</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 21:09:05 user nova-compute[72992]:       <domain type='qemu'/>
Aug 15 21:09:05 user nova-compute[72992]:     </arch>
Aug 15 21:09:05 user nova-compute[72992]:     <features>
Aug 15 21:09:05 user nova-compute[72992]:       <cpuselection/>
Aug 15 21:09:05 user nova-compute[72992]:       <deviceboot/>
Aug 15 21:09:05 user nova-compute[72992]:       <disksnapshot default='on' toggle='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     </features>
Aug 15 21:09:05 user nova-compute[72992]:   </guest>
Aug 15 21:09:05 user nova-compute[72992]: </capabilities>
Aug 15 21:09:05 user nova-compute[72992]: 
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-q35-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>i686</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='288'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'/>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='lm'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-i440fx-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>i686</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='255'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'/>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='lm'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ide</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-i440fx-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>i686</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='255'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'/>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='lm'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ide</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-q35-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>i686</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='288'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'/>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='lm'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-q35-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>x86_64</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='288'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>efi</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='invtsc'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='rsba'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-i440fx-6.2</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>x86_64</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='255'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>efi</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='invtsc'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='rsba'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ide</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-i440fx-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>x86_64</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='255'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>efi</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='invtsc'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='rsba'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ide</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 21:09:05 user nova-compute[72992]: <domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 21:09:05 user nova-compute[72992]:   <domain>kvm</domain>
Aug 15 21:09:05 user nova-compute[72992]:   <machine>pc-q35-jammy</machine>
Aug 15 21:09:05 user nova-compute[72992]:   <arch>x86_64</arch>
Aug 15 21:09:05 user nova-compute[72992]:   <vcpu max='288'/>
Aug 15 21:09:05 user nova-compute[72992]:   <iothreads supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:   <os supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='firmware'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>efi</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:     <loader supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>rom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pflash</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='readonly'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='secure'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>yes</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>no</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </loader>
Aug 15 21:09:05 user nova-compute[72992]:   </os>
Aug 15 21:09:05 user nova-compute[72992]:   <cpu>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-passthrough' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='hostPassthroughMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='maximum' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='maximumMigratable'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>on</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>off</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='host-model' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <vendor>Intel</vendor>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ss'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='vmx'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pcid'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='hypervisor'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arat'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='umip'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='md-clear'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='invtsc'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibpb'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='ibrs'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-stibp'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='rsba'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='erms'/>
Aug 15 21:09:05 user nova-compute[72992]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:     <mode name='custom' supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>qemu64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>qemu32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>phenom</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>pentium</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>n270</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm64</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>kvm32</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>coreduo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>core2duo</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>athlon</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Westmere</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Snowridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Skylake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>SandyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Penryn</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G5</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G4</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G3</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Opteron_G2</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Opteron_G1</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>IvyBridge</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Icelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Haswell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Rome</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-Milan</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>EPYC</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Dhyana</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cooperlake</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>Conroe</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='no'>Broadwell</model>
Aug 15 21:09:05 user nova-compute[72992]:       <model usable='yes'>486</model>
Aug 15 21:09:05 user nova-compute[72992]:     </mode>
Aug 15 21:09:05 user nova-compute[72992]:   </cpu>
Aug 15 21:09:05 user nova-compute[72992]:   <memoryBacking supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:     <enum name='sourceType'>
Aug 15 21:09:05 user nova-compute[72992]:       <value>file</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>anonymous</value>
Aug 15 21:09:05 user nova-compute[72992]:       <value>memfd</value>
Aug 15 21:09:05 user nova-compute[72992]:     </enum>
Aug 15 21:09:05 user nova-compute[72992]:   </memoryBacking>
Aug 15 21:09:05 user nova-compute[72992]:   <devices>
Aug 15 21:09:05 user nova-compute[72992]:     <disk supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='diskDevice'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>disk</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cdrom</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>floppy</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>lun</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='bus'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>fdc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sata</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </disk>
Aug 15 21:09:05 user nova-compute[72992]:     <graphics supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='type'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>sdl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vnc</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>spice</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egl-headless</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </graphics>
Aug 15 21:09:05 user nova-compute[72992]:     <video supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='modelType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>cirrus</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>vmvga</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>qxl</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>none</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>bochs</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>ramfb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </video>
Aug 15 21:09:05 user nova-compute[72992]:     <hostdev supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='mode'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>subsystem</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='startupPolicy'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>default</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>mandatory</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>requisite</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>optional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='subsysType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>usb</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>pci</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>scsi</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='capsType'/>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='pciBackend'/>
Aug 15 21:09:05 user nova-compute[72992]:     </hostdev>
Aug 15 21:09:05 user nova-compute[72992]:     <rng supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtio-non-transitional</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>random</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>egd</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>builtin</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </rng>
Aug 15 21:09:05 user nova-compute[72992]:     <filesystem supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='driverType'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>path</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>handle</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>virtiofs</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </filesystem>
Aug 15 21:09:05 user nova-compute[72992]:     <tpm supported='yes'>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='model'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-tis</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>tpm-crb</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:       <enum name='backendModel'>
Aug 15 21:09:05 user nova-compute[72992]:         <value>passthrough</value>
Aug 15 21:09:05 user nova-compute[72992]:         <value>emulator</value>
Aug 15 21:09:05 user nova-compute[72992]:       </enum>
Aug 15 21:09:05 user nova-compute[72992]:     </tpm>
Aug 15 21:09:05 user nova-compute[72992]:   </devices>
Aug 15 21:09:05 user nova-compute[72992]:   <features>
Aug 15 21:09:05 user nova-compute[72992]:     <gic supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:     <vmcoreinfo supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <genid supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backingStoreInput supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <backup supported='yes'/>
Aug 15 21:09:05 user nova-compute[72992]:     <sev supported='no'/>
Aug 15 21:09:05 user nova-compute[72992]:   </features>
Aug 15 21:09:05 user nova-compute[72992]: </domainCapabilities>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72992) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72992) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Checking secure boot support for host arch (x86_64) {{(pid=72992) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 21:09:05 user nova-compute[72992]: INFO nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Secure Boot support detected
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] cpu compare xml: <cpu match="exact">
Aug 15 21:09:05 user nova-compute[72992]:   <model>Nehalem</model>
Aug 15 21:09:05 user nova-compute[72992]: </cpu>
Aug 15 21:09:05 user nova-compute[72992]:  {{(pid=72992) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 21:09:05 user nova-compute[72992]: INFO nova.virt.node [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Generated node identity 0ba7034c-2c49-478a-ace5-5ede6ef0ca42
Aug 15 21:09:05 user nova-compute[72992]: INFO nova.virt.node [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Wrote node identity 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 to /opt/stack/data/nova/compute_id
Aug 15 21:09:05 user nova-compute[72992]: WARNING nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Compute nodes ['0ba7034c-2c49-478a-ace5-5ede6ef0ca42'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 21:09:05 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 21:09:05 user nova-compute[72992]: WARNING nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 21:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:09:05 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:09:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:09:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Hypervisor/Node resource view: name=user free_ram=10945MB free_disk=26.445659637451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:09:06 user nova-compute[72992]: WARNING nova.compute.resource_tracker [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] No compute node record for user:0ba7034c-2c49-478a-ace5-5ede6ef0ca42: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 could not be found.
Aug 15 21:09:06 user nova-compute[72992]: INFO nova.compute.resource_tracker [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Compute node record created for user:user with uuid: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:09:06 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [req-dda46a2c-2723-406e-bb08-9f08322f9ffb] Created resource provider record via placement API for resource provider with UUID 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 and name user.
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72992) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 21:09:06 user nova-compute[72992]: INFO nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] kernel doesn't support AMD SEV
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Libvirt baseline CPU <cpu>
Aug 15 21:09:06 user nova-compute[72992]:   <arch>x86_64</arch>
Aug 15 21:09:06 user nova-compute[72992]:   <model>Nehalem</model>
Aug 15 21:09:06 user nova-compute[72992]:   <vendor>Intel</vendor>
Aug 15 21:09:06 user nova-compute[72992]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 21:09:06 user nova-compute[72992]: </cpu>
Aug 15 21:09:06 user nova-compute[72992]:  {{(pid=72992) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Updated inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Updating resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 generation from 0 to 1 during operation: update_inventory {{(pid=72992) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Updating resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 generation from 1 to 2 during operation: update_traits {{(pid=72992) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.service [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Creating RPC server for service compute {{(pid=72992) start /opt/stack/nova/nova/service.py:182}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.service [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Join ServiceGroup membership for this service compute {{(pid=72992) start /opt/stack/nova/nova/service.py:199}}
Aug 15 21:09:06 user nova-compute[72992]: DEBUG nova.servicegroup.drivers.db [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72992) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 21:09:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:09:57 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:09:58 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:09:58 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:09:58 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=10295MB free_disk=26.349292755126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:09:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:10:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:10:59 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:11:00 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:11:00 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:11:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=10257MB free_disk=26.397655487060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:11:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:11:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:11:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:11:59 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:12:00 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:12:00 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:12:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=10247MB free_disk=26.179794311523438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:12:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:12:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:12:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:12:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:12:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:12:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:01 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:13:02 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:02 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:02 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=9502MB free_disk=26.20244598388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:13:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:13 user nova-compute[72992]: INFO nova.compute.claims [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Claim successful on node user
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:14 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Creating image(s)
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "/opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "/opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "217026e1-b750-4861-8806-f0d87eaabb45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:14 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:14 user nova-compute[72992]: INFO nova.compute.claims [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Claim successful on node user
Aug 15 21:13:14 user nova-compute[72992]: DEBUG nova.policy [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97e344509ed941aa96fd4039579d65a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5982fc78169c4da5a1cfc5a8676ba36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.part --force-share --output=json" returned: 0 in 0.223s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.virt.images [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] ca16bfd3-6680-457d-af6e-aad43cd3fadd was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.part /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.policy [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96dac56448a242a7817193b06d3ac23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d4659b5fec441f894388f4379fb182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.part /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.converted" returned: 0 in 0.553s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:15 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.765s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:15 user nova-compute[72992]: INFO oslo.privsep.daemon [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3zyg1lm_/privsep.sock']
Aug 15 21:13:15 user sudo[82271]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3zyg1lm_/privsep.sock
Aug 15 21:13:15 user sudo[82271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:15 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Creating image(s)
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "/opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:16 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:16 user nova-compute[72992]: INFO nova.compute.claims [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Claim successful on node user
Aug 15 21:13:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.373s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:17 user nova-compute[72992]: INFO nova.compute.claims [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Claim successful on node user
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Creating image(s)
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.policy [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6ff1260094b492086d5ae874ed7dd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55df905a9e64949ac35075fb206991e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:17 user sudo[82271]: pam_unix(sudo:session): session closed for user root
Aug 15 21:13:17 user nova-compute[72992]: INFO oslo.privsep.daemon [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Spawned new privsep daemon via rootwrap
Aug 15 21:13:17 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 21:13:17 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 21:13:17 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 21:13:17 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82279
Aug 15 21:13:17 user nova-compute[72992]: WARNING oslo_privsep.priv_context [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] privsep daemon already running
Aug 15 21:13:17 user nova-compute[72992]: WARNING oslo_privsep.priv_context [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] privsep daemon already running
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Creating image(s)
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Successfully created port: 431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.policy [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08a032f1741f46ee814186f61b82aac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664606f930f446fabae71df899c94da5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.255s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.290s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Successfully created port: fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "e52158f6-519d-4a8f-99d6-756e64385366" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk 1073741824" returned: 0 in 0.081s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.233s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.170s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:18 user nova-compute[72992]: INFO nova.compute.claims [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Claim successful on node user
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk 1073741824" returned: 0 in 0.066s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.487s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Cannot resize image /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.objects.instance [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'migration_context' on Instance uuid 217026e1-b750-4861-8806-f0d87eaabb45 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Ensure instance console log exists: /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk 1073741824" returned: 0 in 0.054s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.760s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Cannot resize image /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lazy-loading 'migration_context' on Instance uuid b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Ensure instance console log exists: /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.553s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:19 user nova-compute[72992]: INFO nova.compute.claims [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Claim successful on node user
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.222s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk 1073741824" returned: 0 in 0.053s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Cannot resize image /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'migration_context' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Ensure instance console log exists: /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.219s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Creating image(s)
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Cannot resize image /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'migration_context' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Ensure instance console log exists: /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.policy [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ac86e414f5945118a79507ec92a9f45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b6c8e62937043e0abe3f53fd31a3dd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk 1073741824" returned: 0 in 0.042s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:20 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Creating image(s)
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:20 user nova-compute[72992]: INFO nova.compute.claims [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Claim successful on node user
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Cannot resize image /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.objects.instance [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'migration_context' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Ensure instance console log exists: /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.policy [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08a032f1741f46ee814186f61b82aac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664606f930f446fabae71df899c94da5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk 1073741824" returned: 0 in 0.047s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:20 user nova-compute[72992]: DEBUG nova.network.neutron [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Cannot resize image /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'migration_context' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Ensure instance console log exists: /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Creating image(s)
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "/opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.policy [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd12f60b35e7843838c7dcfb4487dee7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41e38d3f853443ea9f6352679b3240f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Successfully created port: 25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.170s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk 1073741824" returned: 0 in 0.042s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Successfully created port: a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.171s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Successfully updated port: fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Successfully updated port: 431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquired lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Cannot resize image /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'migration_context' on Instance uuid 412a57dc-d6a0-44ec-a661-05fed5309955 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Ensure instance console log exists: /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received event network-changed-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Refreshing instance network info cache due to event network-changed-fee09452-43d8-4fd2-af58-2b6312519fa0. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] Acquiring lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received event network-changed-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Refreshing instance network info cache due to event network-changed-431bd72a-de42-4b87-94b0-243b9b599473. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] Acquiring lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:22 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updating instance_info_cache with network_info: [{"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Releasing lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Instance network_info: |[{"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] Acquired lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.neutron [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Refreshing network info cache for port fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Start _get_guest_xml network_info=[{"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-914572132',display_name='tempest-DeleteServersTestJSON-server-914572132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-914572132',id=1,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5982fc78169c4da5a1cfc5a8676ba36f',ramdisk_id='',reservation_id='r-1iom0n8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-297550545',owner_user_name='tempest-DeleteServersTestJSON-297550545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:14Z,user_data=None,user_id='97e344509ed941aa96fd4039579d65a8',uuid=b9ca6a8a-ebfe-47b7-8379-20b0aca36e97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Converting VIF {"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:99,bridge_name='br-int',has_traffic_filtering=True,id=fee09452-43d8-4fd2-af58-2b6312519fa0,network=Network(4a495025-4529-4435-8b56-06631930d62d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee09452-43') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lazy-loading 'pci_devices' on Instance uuid b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:23 user nova-compute[72992]:   <uuid>b9ca6a8a-ebfe-47b7-8379-20b0aca36e97</uuid>
Aug 15 21:13:23 user nova-compute[72992]:   <name>instance-00000001</name>
Aug 15 21:13:23 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:23 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:23 user nova-compute[72992]:   <metadata>
Aug 15 21:13:23 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:23 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:name>tempest-DeleteServersTestJSON-server-914572132</nova:name>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:23</nova:creationTime>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:23 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:23 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:user uuid="97e344509ed941aa96fd4039579d65a8">tempest-DeleteServersTestJSON-297550545-project-member</nova:user>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:project uuid="5982fc78169c4da5a1cfc5a8676ba36f">tempest-DeleteServersTestJSON-297550545</nova:project>
Aug 15 21:13:23 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:port uuid="fee09452-43d8-4fd2-af58-2b6312519fa0">
Aug 15 21:13:23 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:13:23 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:23 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:23 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:23 user nova-compute[72992]:   </metadata>
Aug 15 21:13:23 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:23 user nova-compute[72992]:     <system>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="serial">b9ca6a8a-ebfe-47b7-8379-20b0aca36e97</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="uuid">b9ca6a8a-ebfe-47b7-8379-20b0aca36e97</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:23 user nova-compute[72992]:     </system>
Aug 15 21:13:23 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:23 user nova-compute[72992]:   <os>
Aug 15 21:13:23 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:23 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:23 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:23 user nova-compute[72992]:   </os>
Aug 15 21:13:23 user nova-compute[72992]:   <features>
Aug 15 21:13:23 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:23 user nova-compute[72992]:     <apic/>
Aug 15 21:13:23 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:23 user nova-compute[72992]:   </features>
Aug 15 21:13:23 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:23 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:23 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:23 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:23 user nova-compute[72992]:   </clock>
Aug 15 21:13:23 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:23 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:23 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:23 user nova-compute[72992]:   </cpu>
Aug 15 21:13:23 user nova-compute[72992]:   <devices>
Aug 15 21:13:23 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:23 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:23 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk"/>
Aug 15 21:13:23 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:23 user nova-compute[72992]:     </disk>
Aug 15 21:13:23 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:23 user nova-compute[72992]:       <mac address="fa:16:3e:50:a1:99"/>
Aug 15 21:13:23 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:23 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:23 user nova-compute[72992]:       <target dev="tapfee09452-43"/>
Aug 15 21:13:23 user nova-compute[72992]:     </interface>
Aug 15 21:13:23 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:23 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/console.log" append="off"/>
Aug 15 21:13:23 user nova-compute[72992]:     </serial>
Aug 15 21:13:23 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:23 user nova-compute[72992]:     <video>
Aug 15 21:13:23 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:23 user nova-compute[72992]:     </video>
Aug 15 21:13:23 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:23 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:23 user nova-compute[72992]:     </rng>
Aug 15 21:13:23 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:23 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:23 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:23 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:23 user nova-compute[72992]:   </devices>
Aug 15 21:13:23 user nova-compute[72992]: </domain>
Aug 15 21:13:23 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-914572132',display_name='tempest-DeleteServersTestJSON-server-914572132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-914572132',id=1,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5982fc78169c4da5a1cfc5a8676ba36f',ramdisk_id='',reservation_id='r-1iom0n8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-297550545',owner_user_name='tempest-DeleteServersTestJSON-297550545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:14Z,user_data=None,user_id='97e344509ed941aa96fd4039579d65a8',uuid=b9ca6a8a-ebfe-47b7-8379-20b0aca36e97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Converting VIF {"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:99,bridge_name='br-int',has_traffic_filtering=True,id=fee09452-43d8-4fd2-af58-2b6312519fa0,network=Network(4a495025-4529-4435-8b56-06631930d62d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee09452-43') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG os_vif [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:99,bridge_name='br-int',has_traffic_filtering=True,id=fee09452-43d8-4fd2-af58-2b6312519fa0,network=Network(4a495025-4529-4435-8b56-06631930d62d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee09452-43') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Created schema index Interface.name {{(pid=72992) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Created schema index Port.name {{(pid=72992) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Created schema index Bridge.name {{(pid=72992) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [POLLOUT] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:23 user nova-compute[72992]: INFO oslo.privsep.daemon [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmphpz97ewy/privsep.sock']
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.neutron [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Successfully created port: 5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:23 user sudo[82397]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmphpz97ewy/privsep.sock
Aug 15 21:13:23 user sudo[82397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updating instance_info_cache with network_info: [{"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Instance network_info: |[{"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] Acquired lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.neutron [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Refreshing network info cache for port 431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Start _get_guest_xml network_info=[{"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1793995426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1793995426',id=2,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-mras1vm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:16Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=217026e1-b750-4861-8806-f0d87eaabb45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:1c,bridge_name='br-int',has_traffic_filtering=True,id=431bd72a-de42-4b87-94b0-243b9b599473,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd72a-de') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'pci_devices' on Instance uuid 217026e1-b750-4861-8806-f0d87eaabb45 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:23 user nova-compute[72992]:   <uuid>217026e1-b750-4861-8806-f0d87eaabb45</uuid>
Aug 15 21:13:23 user nova-compute[72992]:   <name>instance-00000002</name>
Aug 15 21:13:23 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:23 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:23 user nova-compute[72992]:   <metadata>
Aug 15 21:13:23 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:23 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1793995426</nova:name>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:23</nova:creationTime>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:23 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:23 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:user uuid="96dac56448a242a7817193b06d3ac23f">tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member</nova:user>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:project uuid="c0d4659b5fec441f894388f4379fb182">tempest-ServerBootFromVolumeStableRescueTest-47310148</nova:project>
Aug 15 21:13:23 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:23 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:23 user nova-compute[72992]:         <nova:port uuid="431bd72a-de42-4b87-94b0-243b9b599473">
Aug 15 21:13:23 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:13:23 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:23 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:23 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:23 user nova-compute[72992]:   </metadata>
Aug 15 21:13:23 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:23 user nova-compute[72992]:     <system>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="serial">217026e1-b750-4861-8806-f0d87eaabb45</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="uuid">217026e1-b750-4861-8806-f0d87eaabb45</entry>
Aug 15 21:13:23 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:23 user nova-compute[72992]:     </system>
Aug 15 21:13:23 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:23 user nova-compute[72992]:   <os>
Aug 15 21:13:23 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:23 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:23 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:23 user nova-compute[72992]:   </os>
Aug 15 21:13:23 user nova-compute[72992]:   <features>
Aug 15 21:13:23 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:23 user nova-compute[72992]:     <apic/>
Aug 15 21:13:23 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:23 user nova-compute[72992]:   </features>
Aug 15 21:13:23 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:23 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:23 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:23 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:23 user nova-compute[72992]:   </clock>
Aug 15 21:13:23 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:23 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:23 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:23 user nova-compute[72992]:   </cpu>
Aug 15 21:13:23 user nova-compute[72992]:   <devices>
Aug 15 21:13:23 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:23 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:23 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk"/>
Aug 15 21:13:23 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:23 user nova-compute[72992]:     </disk>
Aug 15 21:13:23 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:23 user nova-compute[72992]:       <mac address="fa:16:3e:05:f0:1c"/>
Aug 15 21:13:23 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:23 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:23 user nova-compute[72992]:       <target dev="tap431bd72a-de"/>
Aug 15 21:13:23 user nova-compute[72992]:     </interface>
Aug 15 21:13:23 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:23 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/console.log" append="off"/>
Aug 15 21:13:23 user nova-compute[72992]:     </serial>
Aug 15 21:13:23 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:23 user nova-compute[72992]:     <video>
Aug 15 21:13:23 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:23 user nova-compute[72992]:     </video>
Aug 15 21:13:23 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:23 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:23 user nova-compute[72992]:     </rng>
Aug 15 21:13:23 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:23 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:23 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:23 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:23 user nova-compute[72992]:   </devices>
Aug 15 21:13:23 user nova-compute[72992]: </domain>
Aug 15 21:13:23 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1793995426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1793995426',id=2,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-mras1vm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:16Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=217026e1-b750-4861-8806-f0d87eaabb45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:1c,bridge_name='br-int',has_traffic_filtering=True,id=431bd72a-de42-4b87-94b0-243b9b599473,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd72a-de') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG os_vif [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:1c,bridge_name='br-int',has_traffic_filtering=True,id=431bd72a-de42-4b87-94b0-243b9b599473,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd72a-de') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:23 user nova-compute[72992]: DEBUG nova.network.neutron [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Successfully created port: af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:24 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Successfully created port: 0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updated VIF entry in instance network info cache for port 431bd72a-de42-4b87-94b0-243b9b599473. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updating instance_info_cache with network_info: [{"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d1805343-f8b6-4c2a-baef-ed7b6d3f1959 req-5603eb4d-22fc-454b-b6a0-ead6ff1a3319 service nova] Releasing lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updated VIF entry in instance network info cache for port fee09452-43d8-4fd2-af58-2b6312519fa0. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updating instance_info_cache with network_info: [{"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3c3210c0-1ad6-4c3d-a696-6ecbeadcc406 req-5b16cb6e-fa35-4148-811f-614ef07ed640 service nova] Releasing lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:25 user sudo[82397]: pam_unix(sudo:session): session closed for user root
Aug 15 21:13:25 user nova-compute[72992]: INFO oslo.privsep.daemon [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Spawned new privsep daemon via rootwrap
Aug 15 21:13:25 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 21:13:25 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 21:13:25 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 21:13:25 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82400
Aug 15 21:13:25 user nova-compute[72992]: WARNING oslo_privsep.priv_context [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] privsep daemon already running
Aug 15 21:13:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Successfully updated port: 25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquired lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfee09452-43, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfee09452-43, col_values=(('external_ids', {'iface-id': 'fee09452-43d8-4fd2-af58-2b6312519fa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:a1:99', 'vm-uuid': 'b9ca6a8a-ebfe-47b7-8379-20b0aca36e97'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:25 user nova-compute[72992]: INFO os_vif [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a1:99,bridge_name='br-int',has_traffic_filtering=True,id=fee09452-43d8-4fd2-af58-2b6312519fa0,network=Network(4a495025-4529-4435-8b56-06631930d62d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee09452-43')
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap431bd72a-de, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap431bd72a-de, col_values=(('external_ids', {'iface-id': '431bd72a-de42-4b87-94b0-243b9b599473', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:f0:1c', 'vm-uuid': '217026e1-b750-4861-8806-f0d87eaabb45'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:25 user nova-compute[72992]: INFO os_vif [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:1c,bridge_name='br-int',has_traffic_filtering=True,id=431bd72a-de42-4b87-94b0-243b9b599473,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd72a-de')
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] No VIF found with MAC fa:16:3e:50:a1:99, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No VIF found with MAC fa:16:3e:05:f0:1c, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Successfully updated port: a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-changed-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Refreshing instance network info cache due to event network-changed-25b5157e-6099-448c-af89-cc4477901f69. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] Acquiring lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Successfully updated port: af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquired lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-changed-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Refreshing instance network info cache due to event network-changed-af2b7efa-961f-4412-923a-4698c8b198bc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] Acquiring lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Updating instance_info_cache with network_info: [{"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Releasing lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Instance network_info: |[{"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] Acquired lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.neutron [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Refreshing network info cache for port af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Start _get_guest_xml network_info=[{"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-465251854',display_name='tempest-AttachVolumeNegativeTest-server-465251854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-465251854',id=7,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1SJQz80oAmprppTc5CSuF7GyYxBfTeFVYk5Z1F1NzZ/6kKplZuODQzITDugRE9jHfduoR3kC/zpcoK0XYfTrU8O+5yC9AvttX+oamvMFuFYJjmGxXU3dokHlD2F0PrkA==',key_name='tempest-keypair-1668794078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-1gh0247b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=412a57dc-d6a0-44ec-a661-05fed5309955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=af2b7efa-961f-4412-923a-4698c8b198bc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2b7efa-96') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.objects.instance [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'pci_devices' on Instance uuid 412a57dc-d6a0-44ec-a661-05fed5309955 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:27 user nova-compute[72992]:   <uuid>412a57dc-d6a0-44ec-a661-05fed5309955</uuid>
Aug 15 21:13:27 user nova-compute[72992]:   <name>instance-00000007</name>
Aug 15 21:13:27 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:27 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:27 user nova-compute[72992]:   <metadata>
Aug 15 21:13:27 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:27 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeNegativeTest-server-465251854</nova:name>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:27</nova:creationTime>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:27 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:27 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:user uuid="d12f60b35e7843838c7dcfb4487dee7d">tempest-AttachVolumeNegativeTest-1657501102-project-member</nova:user>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:project uuid="b41e38d3f853443ea9f6352679b3240f">tempest-AttachVolumeNegativeTest-1657501102</nova:project>
Aug 15 21:13:27 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:port uuid="af2b7efa-961f-4412-923a-4698c8b198bc">
Aug 15 21:13:27 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 21:13:27 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:27 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:27 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:27 user nova-compute[72992]:   </metadata>
Aug 15 21:13:27 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:27 user nova-compute[72992]:     <system>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="serial">412a57dc-d6a0-44ec-a661-05fed5309955</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="uuid">412a57dc-d6a0-44ec-a661-05fed5309955</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:27 user nova-compute[72992]:     </system>
Aug 15 21:13:27 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:27 user nova-compute[72992]:   <os>
Aug 15 21:13:27 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:27 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:27 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:27 user nova-compute[72992]:   </os>
Aug 15 21:13:27 user nova-compute[72992]:   <features>
Aug 15 21:13:27 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:27 user nova-compute[72992]:     <apic/>
Aug 15 21:13:27 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:27 user nova-compute[72992]:   </features>
Aug 15 21:13:27 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:27 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:27 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:27 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:27 user nova-compute[72992]:   </clock>
Aug 15 21:13:27 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:27 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:27 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:27 user nova-compute[72992]:   </cpu>
Aug 15 21:13:27 user nova-compute[72992]:   <devices>
Aug 15 21:13:27 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:27 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:27 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk"/>
Aug 15 21:13:27 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:27 user nova-compute[72992]:     </disk>
Aug 15 21:13:27 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:27 user nova-compute[72992]:       <mac address="fa:16:3e:47:e0:4a"/>
Aug 15 21:13:27 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:27 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:27 user nova-compute[72992]:       <target dev="tapaf2b7efa-96"/>
Aug 15 21:13:27 user nova-compute[72992]:     </interface>
Aug 15 21:13:27 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:27 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/console.log" append="off"/>
Aug 15 21:13:27 user nova-compute[72992]:     </serial>
Aug 15 21:13:27 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:27 user nova-compute[72992]:     <video>
Aug 15 21:13:27 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:27 user nova-compute[72992]:     </video>
Aug 15 21:13:27 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:27 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:27 user nova-compute[72992]:     </rng>
Aug 15 21:13:27 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:27 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:27 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:27 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:27 user nova-compute[72992]:   </devices>
Aug 15 21:13:27 user nova-compute[72992]: </domain>
Aug 15 21:13:27 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-465251854',display_name='tempest-AttachVolumeNegativeTest-server-465251854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-465251854',id=7,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1SJQz80oAmprppTc5CSuF7GyYxBfTeFVYk5Z1F1NzZ/6kKplZuODQzITDugRE9jHfduoR3kC/zpcoK0XYfTrU8O+5yC9AvttX+oamvMFuFYJjmGxXU3dokHlD2F0PrkA==',key_name='tempest-keypair-1668794078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-1gh0247b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=412a57dc-d6a0-44ec-a661-05fed5309955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=af2b7efa-961f-4412-923a-4698c8b198bc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2b7efa-96') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG os_vif [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=af2b7efa-961f-4412-923a-4698c8b198bc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2b7efa-96') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf2b7efa-96, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf2b7efa-96, col_values=(('external_ids', {'iface-id': 'af2b7efa-961f-4412-923a-4698c8b198bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:e0:4a', 'vm-uuid': '412a57dc-d6a0-44ec-a661-05fed5309955'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:27 user nova-compute[72992]: INFO os_vif [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=af2b7efa-961f-4412-923a-4698c8b198bc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2b7efa-96')
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No VIF found with MAC fa:16:3e:47:e0:4a, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating instance_info_cache with network_info: [{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Releasing lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance network_info: |[{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] Acquired lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.neutron [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Refreshing network info cache for port 25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Start _get_guest_xml network_info=[{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'pci_devices' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:27 user nova-compute[72992]:   <uuid>b198f99d-1575-4ac1-9f66-47d12fda99d9</uuid>
Aug 15 21:13:27 user nova-compute[72992]:   <name>instance-00000004</name>
Aug 15 21:13:27 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:27 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:27 user nova-compute[72992]:   <metadata>
Aug 15 21:13:27 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:27 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeTestJSON-server-552553520</nova:name>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:27</nova:creationTime>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:27 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:27 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:user uuid="c6ff1260094b492086d5ae874ed7dd0d">tempest-AttachVolumeTestJSON-2136218087-project-member</nova:user>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:project uuid="b55df905a9e64949ac35075fb206991e">tempest-AttachVolumeTestJSON-2136218087</nova:project>
Aug 15 21:13:27 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:27 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:27 user nova-compute[72992]:         <nova:port uuid="25b5157e-6099-448c-af89-cc4477901f69">
Aug 15 21:13:27 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 21:13:27 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:27 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:27 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:27 user nova-compute[72992]:   </metadata>
Aug 15 21:13:27 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:27 user nova-compute[72992]:     <system>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="serial">b198f99d-1575-4ac1-9f66-47d12fda99d9</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="uuid">b198f99d-1575-4ac1-9f66-47d12fda99d9</entry>
Aug 15 21:13:27 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:27 user nova-compute[72992]:     </system>
Aug 15 21:13:27 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:27 user nova-compute[72992]:   <os>
Aug 15 21:13:27 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:27 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:27 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:27 user nova-compute[72992]:   </os>
Aug 15 21:13:27 user nova-compute[72992]:   <features>
Aug 15 21:13:27 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:27 user nova-compute[72992]:     <apic/>
Aug 15 21:13:27 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:27 user nova-compute[72992]:   </features>
Aug 15 21:13:27 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:27 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:27 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:27 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:27 user nova-compute[72992]:   </clock>
Aug 15 21:13:27 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:27 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:27 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:27 user nova-compute[72992]:   </cpu>
Aug 15 21:13:27 user nova-compute[72992]:   <devices>
Aug 15 21:13:27 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:27 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:27 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk"/>
Aug 15 21:13:27 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:27 user nova-compute[72992]:     </disk>
Aug 15 21:13:27 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:27 user nova-compute[72992]:       <mac address="fa:16:3e:d7:04:4c"/>
Aug 15 21:13:27 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:27 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:27 user nova-compute[72992]:       <target dev="tap25b5157e-60"/>
Aug 15 21:13:27 user nova-compute[72992]:     </interface>
Aug 15 21:13:27 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:27 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/console.log" append="off"/>
Aug 15 21:13:27 user nova-compute[72992]:     </serial>
Aug 15 21:13:27 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:27 user nova-compute[72992]:     <video>
Aug 15 21:13:27 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:27 user nova-compute[72992]:     </video>
Aug 15 21:13:27 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:27 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:27 user nova-compute[72992]:     </rng>
Aug 15 21:13:27 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:27 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:27 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:27 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:27 user nova-compute[72992]:   </devices>
Aug 15 21:13:27 user nova-compute[72992]: </domain>
Aug 15 21:13:27 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG os_vif [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b5157e-60, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b5157e-60, col_values=(('external_ids', {'iface-id': '25b5157e-6099-448c-af89-cc4477901f69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:04:4c', 'vm-uuid': 'b198f99d-1575-4ac1-9f66-47d12fda99d9'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance network_info: |[{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Start _get_guest_xml network_info=[{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-976509570',display_name='tempest-ServerRescueNegativeTestJSON-server-976509570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-976509570',id=3,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-pu00chv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:18Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=a6e7c604-49e8-47af-a81f-2da89401ea96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'pci_devices' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:28 user nova-compute[72992]: INFO os_vif [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60')
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:28 user nova-compute[72992]:   <uuid>a6e7c604-49e8-47af-a81f-2da89401ea96</uuid>
Aug 15 21:13:28 user nova-compute[72992]:   <name>instance-00000003</name>
Aug 15 21:13:28 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:28 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:28 user nova-compute[72992]:   <metadata>
Aug 15 21:13:28 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:28 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:28 user nova-compute[72992]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-976509570</nova:name>
Aug 15 21:13:28 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:27</nova:creationTime>
Aug 15 21:13:28 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:28 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:28 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:28 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:28 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:28 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:28 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:28 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:28 user nova-compute[72992]:         <nova:user uuid="08a032f1741f46ee814186f61b82aac4">tempest-ServerRescueNegativeTestJSON-600517153-project-member</nova:user>
Aug 15 21:13:28 user nova-compute[72992]:         <nova:project uuid="664606f930f446fabae71df899c94da5">tempest-ServerRescueNegativeTestJSON-600517153</nova:project>
Aug 15 21:13:28 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:28 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:28 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:28 user nova-compute[72992]:         <nova:port uuid="a0331ed5-5162-4b9a-bb4e-9f28a4657d6c">
Aug 15 21:13:28 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:13:28 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:28 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:28 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:28 user nova-compute[72992]:   </metadata>
Aug 15 21:13:28 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:28 user nova-compute[72992]:     <system>
Aug 15 21:13:28 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:28 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:28 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:28 user nova-compute[72992]:       <entry name="serial">a6e7c604-49e8-47af-a81f-2da89401ea96</entry>
Aug 15 21:13:28 user nova-compute[72992]:       <entry name="uuid">a6e7c604-49e8-47af-a81f-2da89401ea96</entry>
Aug 15 21:13:28 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:28 user nova-compute[72992]:     </system>
Aug 15 21:13:28 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:28 user nova-compute[72992]:   <os>
Aug 15 21:13:28 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:28 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:28 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:28 user nova-compute[72992]:   </os>
Aug 15 21:13:28 user nova-compute[72992]:   <features>
Aug 15 21:13:28 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:28 user nova-compute[72992]:     <apic/>
Aug 15 21:13:28 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:28 user nova-compute[72992]:   </features>
Aug 15 21:13:28 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:28 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:28 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:28 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:28 user nova-compute[72992]:   </clock>
Aug 15 21:13:28 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:28 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:28 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:28 user nova-compute[72992]:   </cpu>
Aug 15 21:13:28 user nova-compute[72992]:   <devices>
Aug 15 21:13:28 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:28 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:28 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk"/>
Aug 15 21:13:28 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:28 user nova-compute[72992]:     </disk>
Aug 15 21:13:28 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:28 user nova-compute[72992]:       <mac address="fa:16:3e:68:1e:f7"/>
Aug 15 21:13:28 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:28 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:28 user nova-compute[72992]:       <target dev="tapa0331ed5-51"/>
Aug 15 21:13:28 user nova-compute[72992]:     </interface>
Aug 15 21:13:28 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:28 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/console.log" append="off"/>
Aug 15 21:13:28 user nova-compute[72992]:     </serial>
Aug 15 21:13:28 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:28 user nova-compute[72992]:     <video>
Aug 15 21:13:28 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:28 user nova-compute[72992]:     </video>
Aug 15 21:13:28 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:28 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:28 user nova-compute[72992]:     </rng>
Aug 15 21:13:28 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:28 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:28 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:28 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:28 user nova-compute[72992]:   </devices>
Aug 15 21:13:28 user nova-compute[72992]: </domain>
Aug 15 21:13:28 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-976509570',display_name='tempest-ServerRescueNegativeTestJSON-server-976509570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-976509570',id=3,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-pu00chv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:18Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=a6e7c604-49e8-47af-a81f-2da89401ea96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG os_vif [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0331ed5-51, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0331ed5-51, col_values=(('external_ids', {'iface-id': 'a0331ed5-5162-4b9a-bb4e-9f28a4657d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:1e:f7', 'vm-uuid': 'a6e7c604-49e8-47af-a81f-2da89401ea96'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Successfully updated port: 5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:28 user nova-compute[72992]: INFO os_vif [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51')
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No VIF found with MAC fa:16:3e:d7:04:4c, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No VIF found with MAC fa:16:3e:68:1e:f7, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-changed-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Refreshing instance network info cache due to event network-changed-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] Acquiring lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] Acquired lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Refreshing network info cache for port a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Updated VIF entry in instance network info cache for port af2b7efa-961f-4412-923a-4698c8b198bc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Updating instance_info_cache with network_info: [{"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8cdc8c47-231e-4c16-98c8-e0658eb539a0 req-8a44f2b4-4a1b-47bf-a508-7a8065bd3ca5 service nova] Releasing lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Successfully updated port: 0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance network_info: |[{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Start _get_guest_xml network_info=[{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updated VIF entry in instance network info cache for port 25b5157e-6099-448c-af89-cc4477901f69. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating instance_info_cache with network_info: [{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1ad6d2ed-a635-4bd6-93f6-e1c3cd59925e req-2ddb3943-099a-4ff3-a793-584703a1dd78 service nova] Releasing lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-changed-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Refreshing instance network info cache due to event network-changed-0e7c808f-e1b0-4b77-a5e8-818aa10f314c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] Acquiring lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updated VIF entry in instance network info cache for port a0331ed5-5162-4b9a-bb4e-9f28a4657d6c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] Releasing lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing instance network info cache due to event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updating instance_info_cache with network_info: [{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance network_info: |[{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] Acquired lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Refreshing network info cache for port 0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Start _get_guest_xml network_info=[{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updated VIF entry in instance network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8f46328-9e76-4cf4-bbb9-4004b4d5c1be req-67c73fb5-aa10-4cce-b96c-1f6b27e2fa7d service nova] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updated VIF entry in instance network info cache for port 0e7c808f-e1b0-4b77-a5e8-818aa10f314c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updating instance_info_cache with network_info: [{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7fbebe41-4691-406c-b060-8d84ea96249f req-63229e19-9acb-49b6-985c-ad35a1c3bbe0 service nova] Releasing lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134015.2527795, b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] VM Resumed (Lifecycle Event)
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.compute.claims [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Claim successful on node user
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Instance spawned successfully.
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1417900130',display_name='tempest-ServerStableDeviceRescueTest-server-1417900130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1417900130',id=5,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7ZLnoh6RIZDQRKtYGj4FQkpVRjtE7bTxS4Ap5jRyYQc2IgnS4ni63NGJQvyy6bm+dswlA4+gyM44vcpTqFbp0rgfC74Q471kAJ8u5/3xy/eZsLJvq0j61FQ1uCPDo8qg==',key_name='tempest-keypair-1784868198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b6c8e62937043e0abe3f53fd31a3dd2',ramdisk_id='',reservation_id='r-ij95wf1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-242377571',owner_user_name='tempest-ServerStableDeviceRescueTest-242377571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ac86e414f5945118a79507ec92a9f45',uuid=d7297eef-0545-4a9b-bc17-0cc9eed179d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converting VIF {"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.objects.instance [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'pci_devices' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1286787809',display_name='tempest-ServerRescueNegativeTestJSON-server-1286787809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1286787809',id=6,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-hocp9kpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:20Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=e52158f6-519d-4a8f-99d6-756e64385366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'pci_devices' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:35 user nova-compute[72992]:   <uuid>e52158f6-519d-4a8f-99d6-756e64385366</uuid>
Aug 15 21:13:35 user nova-compute[72992]:   <name>instance-00000006</name>
Aug 15 21:13:35 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:35 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:35 user nova-compute[72992]:   <metadata>
Aug 15 21:13:35 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:35 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1286787809</nova:name>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:35</nova:creationTime>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:35 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:35 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:user uuid="08a032f1741f46ee814186f61b82aac4">tempest-ServerRescueNegativeTestJSON-600517153-project-member</nova:user>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:project uuid="664606f930f446fabae71df899c94da5">tempest-ServerRescueNegativeTestJSON-600517153</nova:project>
Aug 15 21:13:35 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:port uuid="0e7c808f-e1b0-4b77-a5e8-818aa10f314c">
Aug 15 21:13:35 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:13:35 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:35 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:35 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:35 user nova-compute[72992]:   </metadata>
Aug 15 21:13:35 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:35 user nova-compute[72992]:     <system>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="serial">e52158f6-519d-4a8f-99d6-756e64385366</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="uuid">e52158f6-519d-4a8f-99d6-756e64385366</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:35 user nova-compute[72992]:     </system>
Aug 15 21:13:35 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:35 user nova-compute[72992]:   <os>
Aug 15 21:13:35 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:35 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:35 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:35 user nova-compute[72992]:   </os>
Aug 15 21:13:35 user nova-compute[72992]:   <features>
Aug 15 21:13:35 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:35 user nova-compute[72992]:     <apic/>
Aug 15 21:13:35 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:35 user nova-compute[72992]:   </features>
Aug 15 21:13:35 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:35 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:35 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:35 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:35 user nova-compute[72992]:   </clock>
Aug 15 21:13:35 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:35 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:35 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:35 user nova-compute[72992]:   </cpu>
Aug 15 21:13:35 user nova-compute[72992]:   <devices>
Aug 15 21:13:35 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:35 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:35 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk"/>
Aug 15 21:13:35 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:35 user nova-compute[72992]:     </disk>
Aug 15 21:13:35 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:35 user nova-compute[72992]:       <mac address="fa:16:3e:97:bb:5a"/>
Aug 15 21:13:35 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:35 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:35 user nova-compute[72992]:       <target dev="tap0e7c808f-e1"/>
Aug 15 21:13:35 user nova-compute[72992]:     </interface>
Aug 15 21:13:35 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:35 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/console.log" append="off"/>
Aug 15 21:13:35 user nova-compute[72992]:     </serial>
Aug 15 21:13:35 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:35 user nova-compute[72992]:     <video>
Aug 15 21:13:35 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:35 user nova-compute[72992]:     </video>
Aug 15 21:13:35 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:35 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:35 user nova-compute[72992]:     </rng>
Aug 15 21:13:35 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:35 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:35 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:35 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:35 user nova-compute[72992]:   </devices>
Aug 15 21:13:35 user nova-compute[72992]: </domain>
Aug 15 21:13:35 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1286787809',display_name='tempest-ServerRescueNegativeTestJSON-server-1286787809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1286787809',id=6,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-hocp9kpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:20Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=e52158f6-519d-4a8f-99d6-756e64385366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG os_vif [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e7c808f-e1, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e7c808f-e1, col_values=(('external_ids', {'iface-id': '0e7c808f-e1b0-4b77-a5e8-818aa10f314c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:bb:5a', 'vm-uuid': 'e52158f6-519d-4a8f-99d6-756e64385366'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Instance spawned successfully.
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: INFO os_vif [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1')
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:35 user nova-compute[72992]:   <uuid>d7297eef-0545-4a9b-bc17-0cc9eed179d0</uuid>
Aug 15 21:13:35 user nova-compute[72992]:   <name>instance-00000005</name>
Aug 15 21:13:35 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:35 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:35 user nova-compute[72992]:   <metadata>
Aug 15 21:13:35 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:35 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1417900130</nova:name>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:35</nova:creationTime>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:35 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:35 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:user uuid="3ac86e414f5945118a79507ec92a9f45">tempest-ServerStableDeviceRescueTest-242377571-project-member</nova:user>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:project uuid="1b6c8e62937043e0abe3f53fd31a3dd2">tempest-ServerStableDeviceRescueTest-242377571</nova:project>
Aug 15 21:13:35 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:35 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:35 user nova-compute[72992]:         <nova:port uuid="5a2e316b-e6ab-434c-839b-5b914d72a5d4">
Aug 15 21:13:35 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:13:35 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:35 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:35 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:35 user nova-compute[72992]:   </metadata>
Aug 15 21:13:35 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:35 user nova-compute[72992]:     <system>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="serial">d7297eef-0545-4a9b-bc17-0cc9eed179d0</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="uuid">d7297eef-0545-4a9b-bc17-0cc9eed179d0</entry>
Aug 15 21:13:35 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:35 user nova-compute[72992]:     </system>
Aug 15 21:13:35 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:35 user nova-compute[72992]:   <os>
Aug 15 21:13:35 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:35 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:35 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:35 user nova-compute[72992]:   </os>
Aug 15 21:13:35 user nova-compute[72992]:   <features>
Aug 15 21:13:35 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:35 user nova-compute[72992]:     <apic/>
Aug 15 21:13:35 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:35 user nova-compute[72992]:   </features>
Aug 15 21:13:35 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:35 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:35 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:35 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:35 user nova-compute[72992]:   </clock>
Aug 15 21:13:35 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:35 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:35 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:35 user nova-compute[72992]:   </cpu>
Aug 15 21:13:35 user nova-compute[72992]:   <devices>
Aug 15 21:13:35 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:35 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:35 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk"/>
Aug 15 21:13:35 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:35 user nova-compute[72992]:     </disk>
Aug 15 21:13:35 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:35 user nova-compute[72992]:       <mac address="fa:16:3e:fc:74:38"/>
Aug 15 21:13:35 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:35 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:35 user nova-compute[72992]:       <target dev="tap5a2e316b-e6"/>
Aug 15 21:13:35 user nova-compute[72992]:     </interface>
Aug 15 21:13:35 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:35 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/console.log" append="off"/>
Aug 15 21:13:35 user nova-compute[72992]:     </serial>
Aug 15 21:13:35 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:35 user nova-compute[72992]:     <video>
Aug 15 21:13:35 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:35 user nova-compute[72992]:     </video>
Aug 15 21:13:35 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:35 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:35 user nova-compute[72992]:     </rng>
Aug 15 21:13:35 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:35 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:35 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:35 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:35 user nova-compute[72992]:   </devices>
Aug 15 21:13:35 user nova-compute[72992]: </domain>
Aug 15 21:13:35 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1417900130',display_name='tempest-ServerStableDeviceRescueTest-server-1417900130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1417900130',id=5,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7ZLnoh6RIZDQRKtYGj4FQkpVRjtE7bTxS4Ap5jRyYQc2IgnS4ni63NGJQvyy6bm+dswlA4+gyM44vcpTqFbp0rgfC74Q471kAJ8u5/3xy/eZsLJvq0j61FQ1uCPDo8qg==',key_name='tempest-keypair-1784868198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b6c8e62937043e0abe3f53fd31a3dd2',ramdisk_id='',reservation_id='r-ij95wf1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-242377571',owner_user_name='tempest-ServerStableDeviceRescueTest-242377571-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ac86e414f5945118a79507ec92a9f45',uuid=d7297eef-0545-4a9b-bc17-0cc9eed179d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converting VIF {"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG os_vif [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a2e316b-e6, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a2e316b-e6, col_values=(('external_ids', {'iface-id': '5a2e316b-e6ab-434c-839b-5b914d72a5d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:74:38', 'vm-uuid': 'd7297eef-0545-4a9b-bc17-0cc9eed179d0'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134015.2624402, b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] VM Started (Lifecycle Event)
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:35 user nova-compute[72992]: INFO os_vif [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6')
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Took 19.78 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No VIF found with MAC fa:16:3e:fc:74:38, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No VIF found with MAC fa:16:3e:97:bb:5a, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:35 user nova-compute[72992]: INFO nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Took 21.88 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.compute.manager [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Took 21.71 seconds to build instance.
Aug 15 21:13:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fee6fc7d-670b-4117-b354-bc067e86ef31 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "217026e1-b750-4861-8806-f0d87eaabb45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.941s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Instance spawned successfully.
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134015.3688343, 217026e1-b750-4861-8806-f0d87eaabb45 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] VM Resumed (Lifecycle Event)
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance spawned successfully.
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.compute.manager [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Took 23.33 seconds to build instance.
Aug 15 21:13:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.679s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ec0f8f29-0afa-442d-8199-132581cbf084 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.728s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Took 15.66 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134015.370156, 217026e1-b750-4861-8806-f0d87eaabb45 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] VM Started (Lifecycle Event)
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance spawned successfully.
Aug 15 21:13:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Took 16.79 seconds to build instance.
Aug 15 21:13:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-35f5b561-96dc-4b7b-971f-1db2e90df0f4 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.996s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Took 19.82 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134016.286813, 412a57dc-d6a0-44ec-a661-05fed5309955 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] VM Resumed (Lifecycle Event)
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Took 19.47 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.policy [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c86f902acbc4c459532938dd3755593', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6668413892f4783b7fa66117d6590b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134016.2870202, 412a57dc-d6a0-44ec-a661-05fed5309955 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] VM Started (Lifecycle Event)
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Took 20.74 seconds to build instance.
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Creating image(s)
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "/opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "/opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "/opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4c8e7cfd-261c-4eea-801a-34cda1b62bb2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.954s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Took 20.84 seconds to build instance.
Aug 15 21:13:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4cb4ecca-2652-48af-a40e-c6eb26e8cf18 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.973s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134016.408046, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Resumed (Lifecycle Event)
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134016.4119415, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Started (Lifecycle Event)
Aug 15 21:13:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134016.8488498, a6e7c604-49e8-47af-a81f-2da89401ea96 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] VM Resumed (Lifecycle Event)
Aug 15 21:13:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134016.849562, a6e7c604-49e8-47af-a81f-2da89401ea96 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] VM Started (Lifecycle Event)
Aug 15 21:13:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-fbe6f7ef-fb65-4f62-88db-73b6834eb60c req-8b37c3fe-6d02-44ed-ab05-f0b21c093443 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fbe6f7ef-fb65-4f62-88db-73b6834eb60c req-8b37c3fe-6d02-44ed-ab05-f0b21c093443 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fbe6f7ef-fb65-4f62-88db-73b6834eb60c req-8b37c3fe-6d02-44ed-ab05-f0b21c093443 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fbe6f7ef-fb65-4f62-88db-73b6834eb60c req-8b37c3fe-6d02-44ed-ab05-f0b21c093443 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-fbe6f7ef-fb65-4f62-88db-73b6834eb60c req-8b37c3fe-6d02-44ed-ab05-f0b21c093443 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:38 user nova-compute[72992]: WARNING nova.compute.manager [req-fbe6f7ef-fb65-4f62-88db-73b6834eb60c req-8b37c3fe-6d02-44ed-ab05-f0b21c093443 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state active and task_state None.
Aug 15 21:13:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.part --force-share --output=json" returned: 0 in 0.456s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.virt.images [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] 2b288e2c-5624-487c-bf8f-131f2f8a8536 was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:13:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.part /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-5b68f24c-b7f9-47ac-9803-724d38245906 req-f3d81a23-2e9d-4c9a-9586-3d586ef6422e service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received event network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5b68f24c-b7f9-47ac-9803-724d38245906 req-f3d81a23-2e9d-4c9a-9586-3d586ef6422e service nova] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5b68f24c-b7f9-47ac-9803-724d38245906 req-f3d81a23-2e9d-4c9a-9586-3d586ef6422e service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5b68f24c-b7f9-47ac-9803-724d38245906 req-f3d81a23-2e9d-4c9a-9586-3d586ef6422e service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-5b68f24c-b7f9-47ac-9803-724d38245906 req-f3d81a23-2e9d-4c9a-9586-3d586ef6422e service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] No waiting events found dispatching network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:39 user nova-compute[72992]: WARNING nova.compute.manager [req-5b68f24c-b7f9-47ac-9803-724d38245906 req-f3d81a23-2e9d-4c9a-9586-3d586ef6422e service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received unexpected event network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 for instance with vm_state active and task_state None.
Aug 15 21:13:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.part /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.converted" returned: 0 in 0.312s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf.converted --force-share --output=json" returned: 0 in 0.627s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.311s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf --force-share --output=json" returned: 0 in 0.391s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf --force-share --output=json" returned: 0 in 0.423s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf,backing_fmt=raw /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf,backing_fmt=raw /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk 1073741824" returned: 0 in 0.087s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.525s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Successfully created port: 3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received event network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] No waiting events found dispatching network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:41 user nova-compute[72992]: WARNING nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received unexpected event network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 for instance with vm_state active and task_state None.
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received event network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] No waiting events found dispatching network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:41 user nova-compute[72992]: WARNING nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received unexpected event network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 for instance with vm_state active and task_state None.
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received event network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] No waiting events found dispatching network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:41 user nova-compute[72992]: WARNING nova.compute.manager [req-e68c4179-1782-4f7d-9bcb-4b2e43aa7e36 req-5b53e01e-e4fd-4168-b54c-87669c11585d service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received unexpected event network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 for instance with vm_state active and task_state None.
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-b9d7bb07-e37d-45e1-8307-d56beb5937d0 req-c0fdea04-7174-4ba1-ab72-fd858ca88563 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b9d7bb07-e37d-45e1-8307-d56beb5937d0 req-c0fdea04-7174-4ba1-ab72-fd858ca88563 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b9d7bb07-e37d-45e1-8307-d56beb5937d0 req-c0fdea04-7174-4ba1-ab72-fd858ca88563 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b9d7bb07-e37d-45e1-8307-d56beb5937d0 req-c0fdea04-7174-4ba1-ab72-fd858ca88563 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-b9d7bb07-e37d-45e1-8307-d56beb5937d0 req-c0fdea04-7174-4ba1-ab72-fd858ca88563 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:41 user nova-compute[72992]: WARNING nova.compute.manager [req-b9d7bb07-e37d-45e1-8307-d56beb5937d0 req-c0fdea04-7174-4ba1-ab72-fd858ca88563 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state active and task_state None.
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf --force-share --output=json" returned: 0 in 0.498s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json" returned: 0 in 0.483s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Cannot resize image /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lazy-loading 'migration_context' on Instance uuid 81bd731c-9957-41c5-9ecb-460870323a44 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Ensure instance console log exists: /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Successfully updated port: 3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-changed-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Refreshing instance network info cache due to event network-changed-3948f668-80b4-4292-bff0-2274bc789d51. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] Acquiring lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] Acquired lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Refreshing network info cache for port 3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134024.0292702, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] VM Resumed (Lifecycle Event)
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance spawned successfully.
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134024.0294826, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] VM Started (Lifecycle Event)
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-313137ba-2a46-4724-a0f0-3a0582612145 req-2a465c2a-5446-4471-8035-dd39fb14a19e service nova] Releasing lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquired lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Took 24.82 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134024.5597289, e52158f6-519d-4a8f-99d6-756e64385366 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] VM Resumed (Lifecycle Event)
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Took 26.22 seconds to build instance.
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance spawned successfully.
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-16dcd77c-fedd-4234-ae37-483c1b7c443e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.409s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134024.5599787, e52158f6-519d-4a8f-99d6-756e64385366 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] VM Started (Lifecycle Event)
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:44 user nova-compute[72992]: INFO nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Took 24.74 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:45 user nova-compute[72992]: INFO nova.compute.manager [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Took 26.53 seconds to build instance.
Aug 15 21:13:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d9f0b193-ac96-408e-8849-20895b3a47c2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "e52158f6-519d-4a8f-99d6-756e64385366" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.743s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Updating instance_info_cache with network_info: [{"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Releasing lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Instance network_info: |[{"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Start _get_guest_xml network_info=[{"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:13:28Z,direct_url=<?>,disk_format='qcow2',id=2b288e2c-5624-487c-bf8f-131f2f8a8536,min_disk=0,min_ram=0,name='',owner='7e9fcf84b60d47aaaacd4fe489b2089a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:13:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '2b288e2c-5624-487c-bf8f-131f2f8a8536'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:45 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:45 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:13:28Z,direct_url=<?>,disk_format='qcow2',id=2b288e2c-5624-487c-bf8f-131f2f8a8536,min_disk=0,min_ram=0,name='',owner='7e9fcf84b60d47aaaacd4fe489b2089a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:13:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-593527229',display_name='tempest-AttachSCSIVolumeTestJSON-server-593527229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-593527229',id=8,image_ref='2b288e2c-5624-487c-bf8f-131f2f8a8536',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOZnDvpGfMn2HZa7yN5UvdBjhLx4BsqGmpBeM1q7AIt+u+cnQUyaInVMVRK5WEmhaO8DD+MI2PVA0a2q8g3iClAbCu6OVyGmfAZEyNIUvCXNB++95xiUum3Zq0unJaHvg==',key_name='tempest-keypair-2082084740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6668413892f4783b7fa66117d6590b3',ramdisk_id='',reservation_id='r-hxkw717t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2b288e2c-5624-487c-bf8f-131f2f8a8536',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1231045332',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1231045332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c86f902acbc4c459532938dd3755593',uuid=81bd731c-9957-41c5-9ecb-460870323a44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Converting VIF {"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:db:35,bridge_name='br-int',has_traffic_filtering=True,id=3948f668-80b4-4292-bff0-2274bc789d51,network=Network(4fdcf84a-e8ed-4513-b472-3603d007dd1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3948f668-80') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lazy-loading 'pci_devices' on Instance uuid 81bd731c-9957-41c5-9ecb-460870323a44 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:45 user nova-compute[72992]:   <uuid>81bd731c-9957-41c5-9ecb-460870323a44</uuid>
Aug 15 21:13:45 user nova-compute[72992]:   <name>instance-00000008</name>
Aug 15 21:13:45 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:45 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:45 user nova-compute[72992]:   <metadata>
Aug 15 21:13:45 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:45 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:45 user nova-compute[72992]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-593527229</nova:name>
Aug 15 21:13:45 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:45</nova:creationTime>
Aug 15 21:13:45 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:45 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:45 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:45 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:45 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:45 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:45 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:45 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:45 user nova-compute[72992]:         <nova:user uuid="1c86f902acbc4c459532938dd3755593">tempest-AttachSCSIVolumeTestJSON-1231045332-project-member</nova:user>
Aug 15 21:13:45 user nova-compute[72992]:         <nova:project uuid="c6668413892f4783b7fa66117d6590b3">tempest-AttachSCSIVolumeTestJSON-1231045332</nova:project>
Aug 15 21:13:45 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:45 user nova-compute[72992]:       <nova:root type="image" uuid="2b288e2c-5624-487c-bf8f-131f2f8a8536"/>
Aug 15 21:13:45 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:45 user nova-compute[72992]:         <nova:port uuid="3948f668-80b4-4292-bff0-2274bc789d51">
Aug 15 21:13:45 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:13:45 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:45 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:45 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:45 user nova-compute[72992]:   </metadata>
Aug 15 21:13:45 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:45 user nova-compute[72992]:     <system>
Aug 15 21:13:45 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:45 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:45 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:45 user nova-compute[72992]:       <entry name="serial">81bd731c-9957-41c5-9ecb-460870323a44</entry>
Aug 15 21:13:45 user nova-compute[72992]:       <entry name="uuid">81bd731c-9957-41c5-9ecb-460870323a44</entry>
Aug 15 21:13:45 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:45 user nova-compute[72992]:     </system>
Aug 15 21:13:45 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:45 user nova-compute[72992]:   <os>
Aug 15 21:13:45 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:45 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:45 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:45 user nova-compute[72992]:   </os>
Aug 15 21:13:45 user nova-compute[72992]:   <features>
Aug 15 21:13:45 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:45 user nova-compute[72992]:     <apic/>
Aug 15 21:13:45 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:45 user nova-compute[72992]:   </features>
Aug 15 21:13:45 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:45 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:45 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:45 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:45 user nova-compute[72992]:   </clock>
Aug 15 21:13:45 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:45 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:45 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:45 user nova-compute[72992]:   </cpu>
Aug 15 21:13:45 user nova-compute[72992]:   <devices>
Aug 15 21:13:45 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:45 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:45 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk"/>
Aug 15 21:13:45 user nova-compute[72992]:       <target dev="sda" bus="scsi"/>
Aug 15 21:13:45 user nova-compute[72992]:       <address type="drive" controller="0" unit="0"/>
Aug 15 21:13:45 user nova-compute[72992]:     </disk>
Aug 15 21:13:45 user nova-compute[72992]:     <disk type="file" device="cdrom">
Aug 15 21:13:45 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 21:13:45 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk.config"/>
Aug 15 21:13:45 user nova-compute[72992]:       <target dev="sdb" bus="scsi"/>
Aug 15 21:13:45 user nova-compute[72992]:       <address type="drive" controller="0" unit="1"/>
Aug 15 21:13:45 user nova-compute[72992]:     </disk>
Aug 15 21:13:45 user nova-compute[72992]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 21:13:45 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:45 user nova-compute[72992]:       <mac address="fa:16:3e:23:db:35"/>
Aug 15 21:13:45 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:45 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:45 user nova-compute[72992]:       <target dev="tap3948f668-80"/>
Aug 15 21:13:45 user nova-compute[72992]:     </interface>
Aug 15 21:13:45 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:45 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/console.log" append="off"/>
Aug 15 21:13:45 user nova-compute[72992]:     </serial>
Aug 15 21:13:45 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:45 user nova-compute[72992]:     <video>
Aug 15 21:13:45 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:45 user nova-compute[72992]:     </video>
Aug 15 21:13:45 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:45 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:45 user nova-compute[72992]:     </rng>
Aug 15 21:13:45 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:45 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:45 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:45 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:45 user nova-compute[72992]:   </devices>
Aug 15 21:13:45 user nova-compute[72992]: </domain>
Aug 15 21:13:45 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-593527229',display_name='tempest-AttachSCSIVolumeTestJSON-server-593527229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-593527229',id=8,image_ref='2b288e2c-5624-487c-bf8f-131f2f8a8536',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOZnDvpGfMn2HZa7yN5UvdBjhLx4BsqGmpBeM1q7AIt+u+cnQUyaInVMVRK5WEmhaO8DD+MI2PVA0a2q8g3iClAbCu6OVyGmfAZEyNIUvCXNB++95xiUum3Zq0unJaHvg==',key_name='tempest-keypair-2082084740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6668413892f4783b7fa66117d6590b3',ramdisk_id='',reservation_id='r-hxkw717t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2b288e2c-5624-487c-bf8f-131f2f8a8536',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1231045332',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1231045332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c86f902acbc4c459532938dd3755593',uuid=81bd731c-9957-41c5-9ecb-460870323a44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Converting VIF {"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:db:35,bridge_name='br-int',has_traffic_filtering=True,id=3948f668-80b4-4292-bff0-2274bc789d51,network=Network(4fdcf84a-e8ed-4513-b472-3603d007dd1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3948f668-80') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG os_vif [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:db:35,bridge_name='br-int',has_traffic_filtering=True,id=3948f668-80b4-4292-bff0-2274bc789d51,network=Network(4fdcf84a-e8ed-4513-b472-3603d007dd1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3948f668-80') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3948f668-80, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3948f668-80, col_values=(('external_ids', {'iface-id': '3948f668-80b4-4292-bff0-2274bc789d51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:db:35', 'vm-uuid': '81bd731c-9957-41c5-9ecb-460870323a44'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:45 user nova-compute[72992]: INFO os_vif [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:db:35,bridge_name='br-int',has_traffic_filtering=True,id=3948f668-80b4-4292-bff0-2274bc789d51,network=Network(4fdcf84a-e8ed-4513-b472-3603d007dd1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3948f668-80')
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] No BDM found with device name sda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] No VIF found with MAC fa:16:3e:23:db:35, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Using config drive
Aug 15 21:13:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Creating config drive at /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk.config
Aug 15 21:13:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgdworrms {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgdworrms" returned: 0 in 0.075s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:47 user nova-compute[72992]: INFO nova.compute.claims [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Claim successful on node user
Aug 15 21:13:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-36ee47cb-fe5c-49a7-b5d1-061f7caceb7f req-e5f572a3-0634-4d8d-9b99-e70bee3f637f service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-36ee47cb-fe5c-49a7-b5d1-061f7caceb7f req-e5f572a3-0634-4d8d-9b99-e70bee3f637f service nova] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-36ee47cb-fe5c-49a7-b5d1-061f7caceb7f req-e5f572a3-0634-4d8d-9b99-e70bee3f637f service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-36ee47cb-fe5c-49a7-b5d1-061f7caceb7f req-e5f572a3-0634-4d8d-9b99-e70bee3f637f service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-36ee47cb-fe5c-49a7-b5d1-061f7caceb7f req-e5f572a3-0634-4d8d-9b99-e70bee3f637f service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] No waiting events found dispatching network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:48 user nova-compute[72992]: WARNING nova.compute.manager [req-36ee47cb-fe5c-49a7-b5d1-061f7caceb7f req-e5f572a3-0634-4d8d-9b99-e70bee3f637f service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received unexpected event network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 for instance with vm_state building and task_state spawning.
Aug 15 21:13:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.468s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG nova.policy [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0701e4d18de7432d9088b1018a9d6b97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b39052f1714498a90b3be2b3ba63a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Creating image(s)
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "/opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "/opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-40e74ce9-14bd-4fc3-abc1-841a423373c1 req-1f96cc17-8c9b-4909-846e-b3b56737837c service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-40e74ce9-14bd-4fc3-abc1-841a423373c1 req-1f96cc17-8c9b-4909-846e-b3b56737837c service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-40e74ce9-14bd-4fc3-abc1-841a423373c1 req-1f96cc17-8c9b-4909-846e-b3b56737837c service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-40e74ce9-14bd-4fc3-abc1-841a423373c1 req-1f96cc17-8c9b-4909-846e-b3b56737837c service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-40e74ce9-14bd-4fc3-abc1-841a423373c1 req-1f96cc17-8c9b-4909-846e-b3b56737837c service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:49 user nova-compute[72992]: WARNING nova.compute.manager [req-40e74ce9-14bd-4fc3-abc1-841a423373c1 req-1f96cc17-8c9b-4909-846e-b3b56737837c service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state active and task_state None.
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.413s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.472s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk 1073741824" returned: 0 in 0.137s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.615s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Successfully created port: f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-3e63204c-13fb-4a1a-9f89-48cbc7f742fc req-f06d1a2a-5e60-45ac-852c-c3610b5de94b service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e63204c-13fb-4a1a-9f89-48cbc7f742fc req-f06d1a2a-5e60-45ac-852c-c3610b5de94b service nova] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e63204c-13fb-4a1a-9f89-48cbc7f742fc req-f06d1a2a-5e60-45ac-852c-c3610b5de94b service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e63204c-13fb-4a1a-9f89-48cbc7f742fc req-f06d1a2a-5e60-45ac-852c-c3610b5de94b service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-3e63204c-13fb-4a1a-9f89-48cbc7f742fc req-f06d1a2a-5e60-45ac-852c-c3610b5de94b service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] No waiting events found dispatching network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:50 user nova-compute[72992]: WARNING nova.compute.manager [req-3e63204c-13fb-4a1a-9f89-48cbc7f742fc req-f06d1a2a-5e60-45ac-852c-c3610b5de94b service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received unexpected event network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 for instance with vm_state building and task_state spawning.
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.355s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Cannot resize image /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lazy-loading 'migration_context' on Instance uuid 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Ensure instance console log exists: /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-5ac8bc55-d126-498c-b014-9f06775da35e req-3d7dd356-a988-4c2b-8a75-e405a0e34cdb service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5ac8bc55-d126-498c-b014-9f06775da35e req-3d7dd356-a988-4c2b-8a75-e405a0e34cdb service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5ac8bc55-d126-498c-b014-9f06775da35e req-3d7dd356-a988-4c2b-8a75-e405a0e34cdb service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5ac8bc55-d126-498c-b014-9f06775da35e req-3d7dd356-a988-4c2b-8a75-e405a0e34cdb service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-5ac8bc55-d126-498c-b014-9f06775da35e req-3d7dd356-a988-4c2b-8a75-e405a0e34cdb service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:51 user nova-compute[72992]: WARNING nova.compute.manager [req-5ac8bc55-d126-498c-b014-9f06775da35e req-3d7dd356-a988-4c2b-8a75-e405a0e34cdb service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state active and task_state None.
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134031.958733, 81bd731c-9957-41c5-9ecb-460870323a44 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:51 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] VM Resumed (Lifecycle Event)
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Instance spawned successfully.
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Successfully updated port: f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:52 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134031.9592164, 81bd731c-9957-41c5-9ecb-460870323a44 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:52 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] VM Started (Lifecycle Event)
Aug 15 21:13:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquired lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:52 user nova-compute[72992]: INFO nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Took 14.79 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:52 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:52 user nova-compute[72992]: INFO nova.compute.manager [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Took 17.60 seconds to build instance.
Aug 15 21:13:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0ddc9f37-c94f-4fc4-b8b0-b69fd0e0cc0d tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.899s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-changed-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Refreshing instance network info cache due to event network-changed-f24d6e3f-eaef-4a2a-8553-3465e82231ca. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] Acquiring lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Updating instance_info_cache with network_info: [{"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Releasing lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Instance network_info: |[{"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] Acquired lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.network.neutron [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Refreshing network info cache for port f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Start _get_guest_xml network_info=[{"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:13:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-309726332',display_name='tempest-VolumesAssistedSnapshotsTest-server-309726332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-309726332',id=9,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvfZhDAG14wMCHAC1J3CTPThu/z8DfGsuseYimuvPlLxTgZ3ucf7yIUuVRcDbfjNq2J2Sc0WJcWYkA1jj7IE9IAsYWEzQs1LwZG5hidg8o7YBF8j+nQwIGCfk1xzTwNzg==',key_name='tempest-keypair-128464557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b39052f1714498a90b3be2b3ba63a4',ramdisk_id='',reservation_id='r-3utr2c6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-775922290',owner_user_name='tempest-VolumesAssistedSnapshotsTest-775922290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0701e4d18de7432d9088b1018a9d6b97',uuid=9bc3a41b-c56e-41db-9897-bd9f7554869d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Converting VIF {"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:06:50,bridge_name='br-int',has_traffic_filtering=True,id=f24d6e3f-eaef-4a2a-8553-3465e82231ca,network=Network(248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf24d6e3f-ea') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:53 user nova-compute[72992]:   <uuid>9bc3a41b-c56e-41db-9897-bd9f7554869d</uuid>
Aug 15 21:13:53 user nova-compute[72992]:   <name>instance-00000009</name>
Aug 15 21:13:53 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:53 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:53 user nova-compute[72992]:   <metadata>
Aug 15 21:13:53 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:53 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:53 user nova-compute[72992]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-309726332</nova:name>
Aug 15 21:13:53 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:53</nova:creationTime>
Aug 15 21:13:53 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:53 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:53 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:53 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:53 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:53 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:53 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:53 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:53 user nova-compute[72992]:         <nova:user uuid="0701e4d18de7432d9088b1018a9d6b97">tempest-VolumesAssistedSnapshotsTest-775922290-project-member</nova:user>
Aug 15 21:13:53 user nova-compute[72992]:         <nova:project uuid="09b39052f1714498a90b3be2b3ba63a4">tempest-VolumesAssistedSnapshotsTest-775922290</nova:project>
Aug 15 21:13:53 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:53 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:53 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:53 user nova-compute[72992]:         <nova:port uuid="f24d6e3f-eaef-4a2a-8553-3465e82231ca">
Aug 15 21:13:53 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 21:13:53 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:53 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:53 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:53 user nova-compute[72992]:   </metadata>
Aug 15 21:13:53 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:53 user nova-compute[72992]:     <system>
Aug 15 21:13:53 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:53 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:53 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:53 user nova-compute[72992]:       <entry name="serial">9bc3a41b-c56e-41db-9897-bd9f7554869d</entry>
Aug 15 21:13:53 user nova-compute[72992]:       <entry name="uuid">9bc3a41b-c56e-41db-9897-bd9f7554869d</entry>
Aug 15 21:13:53 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:53 user nova-compute[72992]:     </system>
Aug 15 21:13:53 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:53 user nova-compute[72992]:   <os>
Aug 15 21:13:53 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:53 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:53 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:53 user nova-compute[72992]:   </os>
Aug 15 21:13:53 user nova-compute[72992]:   <features>
Aug 15 21:13:53 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:53 user nova-compute[72992]:     <apic/>
Aug 15 21:13:53 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:53 user nova-compute[72992]:   </features>
Aug 15 21:13:53 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:53 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:53 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:53 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:53 user nova-compute[72992]:   </clock>
Aug 15 21:13:53 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:53 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:53 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:53 user nova-compute[72992]:   </cpu>
Aug 15 21:13:53 user nova-compute[72992]:   <devices>
Aug 15 21:13:53 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:53 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:53 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk"/>
Aug 15 21:13:53 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:53 user nova-compute[72992]:     </disk>
Aug 15 21:13:53 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:53 user nova-compute[72992]:       <mac address="fa:16:3e:e3:06:50"/>
Aug 15 21:13:53 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:53 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:53 user nova-compute[72992]:       <target dev="tapf24d6e3f-ea"/>
Aug 15 21:13:53 user nova-compute[72992]:     </interface>
Aug 15 21:13:53 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:53 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/console.log" append="off"/>
Aug 15 21:13:53 user nova-compute[72992]:     </serial>
Aug 15 21:13:53 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:53 user nova-compute[72992]:     <video>
Aug 15 21:13:53 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:53 user nova-compute[72992]:     </video>
Aug 15 21:13:53 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:53 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:53 user nova-compute[72992]:     </rng>
Aug 15 21:13:53 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:53 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:53 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:53 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:53 user nova-compute[72992]:   </devices>
Aug 15 21:13:53 user nova-compute[72992]: </domain>
Aug 15 21:13:53 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-309726332',display_name='tempest-VolumesAssistedSnapshotsTest-server-309726332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-309726332',id=9,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvfZhDAG14wMCHAC1J3CTPThu/z8DfGsuseYimuvPlLxTgZ3ucf7yIUuVRcDbfjNq2J2Sc0WJcWYkA1jj7IE9IAsYWEzQs1LwZG5hidg8o7YBF8j+nQwIGCfk1xzTwNzg==',key_name='tempest-keypair-128464557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b39052f1714498a90b3be2b3ba63a4',ramdisk_id='',reservation_id='r-3utr2c6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-775922290',owner_user_name='tempest-VolumesAssistedSnapshotsTest-775922290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0701e4d18de7432d9088b1018a9d6b97',uuid=9bc3a41b-c56e-41db-9897-bd9f7554869d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Converting VIF {"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:06:50,bridge_name='br-int',has_traffic_filtering=True,id=f24d6e3f-eaef-4a2a-8553-3465e82231ca,network=Network(248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf24d6e3f-ea') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG os_vif [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:06:50,bridge_name='br-int',has_traffic_filtering=True,id=f24d6e3f-eaef-4a2a-8553-3465e82231ca,network=Network(248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf24d6e3f-ea') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf24d6e3f-ea, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf24d6e3f-ea, col_values=(('external_ids', {'iface-id': 'f24d6e3f-eaef-4a2a-8553-3465e82231ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:06:50', 'vm-uuid': '9bc3a41b-c56e-41db-9897-bd9f7554869d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:53 user nova-compute[72992]: INFO os_vif [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:06:50,bridge_name='br-int',has_traffic_filtering=True,id=f24d6e3f-eaef-4a2a-8553-3465e82231ca,network=Network(248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf24d6e3f-ea')
Aug 15 21:13:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:13:53 user nova-compute[72992]: INFO nova.compute.claims [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Claim successful on node user
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] No VIF found with MAC fa:16:3e:e3:06:50, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Updated VIF entry in instance network info cache for port f24d6e3f-eaef-4a2a-8553-3465e82231ca. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Updating instance_info_cache with network_info: [{"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-40dde100-e339-4404-87c5-905fb4930f1b req-b398802f-8128-4567-b095-559c6922dfbc service nova] Releasing lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.080s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:13:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:13:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG nova.policy [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0188ea63e796441294fe121527359a12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0aa5ec24cfc4e43935a90a8ac5cbe52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:13:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Creating image(s)
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "/opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "/opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.431s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-4f8c2111-a552-405b-a2ed-52b39a7d8e8b req-084a7b26-5dc8-423d-ae91-dbe92e02c928 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4f8c2111-a552-405b-a2ed-52b39a7d8e8b req-084a7b26-5dc8-423d-ae91-dbe92e02c928 service nova] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4f8c2111-a552-405b-a2ed-52b39a7d8e8b req-084a7b26-5dc8-423d-ae91-dbe92e02c928 service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4f8c2111-a552-405b-a2ed-52b39a7d8e8b req-084a7b26-5dc8-423d-ae91-dbe92e02c928 service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-4f8c2111-a552-405b-a2ed-52b39a7d8e8b req-084a7b26-5dc8-423d-ae91-dbe92e02c928 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] No waiting events found dispatching network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:56 user nova-compute[72992]: WARNING nova.compute.manager [req-4f8c2111-a552-405b-a2ed-52b39a7d8e8b req-084a7b26-5dc8-423d-ae91-dbe92e02c928 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received unexpected event network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca for instance with vm_state building and task_state spawning.
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.461s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk 1073741824" returned: 0 in 0.219s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.686s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Successfully created port: 0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.387s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Cannot resize image /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:13:56 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lazy-loading 'migration_context' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Ensure instance console log exists: /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Successfully updated port: 0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-changed-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Refreshing instance network info cache due to event network-changed-0f6e4fe9-7e44-4003-90c7-54196c955c0d. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] Acquiring lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] Acquired lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.network.neutron [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Refreshing network info cache for port 0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG nova.network.neutron [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-b14c2f2f-2988-4976-ab6d-5e018244b6da req-39f1cc6e-74c4-4f89-95f7-9208ec76b925 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b14c2f2f-2988-4976-ab6d-5e018244b6da req-39f1cc6e-74c4-4f89-95f7-9208ec76b925 service nova] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b14c2f2f-2988-4976-ab6d-5e018244b6da req-39f1cc6e-74c4-4f89-95f7-9208ec76b925 service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b14c2f2f-2988-4976-ab6d-5e018244b6da req-39f1cc6e-74c4-4f89-95f7-9208ec76b925 service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-b14c2f2f-2988-4976-ab6d-5e018244b6da req-39f1cc6e-74c4-4f89-95f7-9208ec76b925 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] No waiting events found dispatching network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:13:58 user nova-compute[72992]: WARNING nova.compute.manager [req-b14c2f2f-2988-4976-ab6d-5e018244b6da req-39f1cc6e-74c4-4f89-95f7-9208ec76b925 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received unexpected event network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca for instance with vm_state building and task_state spawning.
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5dd5431c-6099-43b9-9554-99c1d7811723 req-d3ccf58d-e4fe-4626-8d79-ae30093a0fa4 service nova] Releasing lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquired lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Updating instance_info_cache with network_info: [{"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Releasing lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Instance network_info: |[{"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Start _get_guest_xml network_info=[{"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:13:58 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:58 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-987850189',display_name='tempest-TestVolumeSwap-server-987850189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-987850189',id=10,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLB6wVGQVbpUMWHv5g1RzSm/+1RmlbXCKK5oEcU0yvCbNH8YcTKWlkVhMqb1gzAPnKBSH5q2FfAG5tIuu+moO19ebHGf9PInf6aUP22yiGynu1wg5m7ElVVfEAMoLdWaw==',key_name='tempest-keypair-164681680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0aa5ec24cfc4e43935a90a8ac5cbe52',ramdisk_id='',reservation_id='r-podsb8zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1778895763',owner_user_name='tempest-TestVolumeSwap-1778895763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0188ea63e796441294fe121527359a12',uuid=bd51cb75-790e-4c23-8c48-a3de273b900f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Converting VIF {"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c5:8d,bridge_name='br-int',has_traffic_filtering=True,id=0f6e4fe9-7e44-4003-90c7-54196c955c0d,network=Network(b4e6963b-327c-45a0-b17c-b28ebddefa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e4fe9-7e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lazy-loading 'pci_devices' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134038.730831, 9bc3a41b-c56e-41db-9897-bd9f7554869d => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:58 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] VM Resumed (Lifecycle Event)
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:13:58 user nova-compute[72992]:   <uuid>bd51cb75-790e-4c23-8c48-a3de273b900f</uuid>
Aug 15 21:13:58 user nova-compute[72992]:   <name>instance-0000000a</name>
Aug 15 21:13:58 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:13:58 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:13:58 user nova-compute[72992]:   <metadata>
Aug 15 21:13:58 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:13:58 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:13:58 user nova-compute[72992]:       <nova:name>tempest-TestVolumeSwap-server-987850189</nova:name>
Aug 15 21:13:58 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:13:58</nova:creationTime>
Aug 15 21:13:58 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:13:58 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:13:58 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:13:58 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:13:58 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:13:58 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:13:58 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:13:58 user nova-compute[72992]:       <nova:owner>
Aug 15 21:13:58 user nova-compute[72992]:         <nova:user uuid="0188ea63e796441294fe121527359a12">tempest-TestVolumeSwap-1778895763-project-member</nova:user>
Aug 15 21:13:58 user nova-compute[72992]:         <nova:project uuid="c0aa5ec24cfc4e43935a90a8ac5cbe52">tempest-TestVolumeSwap-1778895763</nova:project>
Aug 15 21:13:58 user nova-compute[72992]:       </nova:owner>
Aug 15 21:13:58 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:13:58 user nova-compute[72992]:       <nova:ports>
Aug 15 21:13:58 user nova-compute[72992]:         <nova:port uuid="0f6e4fe9-7e44-4003-90c7-54196c955c0d">
Aug 15 21:13:58 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:13:58 user nova-compute[72992]:         </nova:port>
Aug 15 21:13:58 user nova-compute[72992]:       </nova:ports>
Aug 15 21:13:58 user nova-compute[72992]:     </nova:instance>
Aug 15 21:13:58 user nova-compute[72992]:   </metadata>
Aug 15 21:13:58 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:13:58 user nova-compute[72992]:     <system>
Aug 15 21:13:58 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:13:58 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:13:58 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:13:58 user nova-compute[72992]:       <entry name="serial">bd51cb75-790e-4c23-8c48-a3de273b900f</entry>
Aug 15 21:13:58 user nova-compute[72992]:       <entry name="uuid">bd51cb75-790e-4c23-8c48-a3de273b900f</entry>
Aug 15 21:13:58 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:13:58 user nova-compute[72992]:     </system>
Aug 15 21:13:58 user nova-compute[72992]:   </sysinfo>
Aug 15 21:13:58 user nova-compute[72992]:   <os>
Aug 15 21:13:58 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:13:58 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:13:58 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:13:58 user nova-compute[72992]:   </os>
Aug 15 21:13:58 user nova-compute[72992]:   <features>
Aug 15 21:13:58 user nova-compute[72992]:     <acpi/>
Aug 15 21:13:58 user nova-compute[72992]:     <apic/>
Aug 15 21:13:58 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:13:58 user nova-compute[72992]:   </features>
Aug 15 21:13:58 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:13:58 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:13:58 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:13:58 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:13:58 user nova-compute[72992]:   </clock>
Aug 15 21:13:58 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:13:58 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:13:58 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:13:58 user nova-compute[72992]:   </cpu>
Aug 15 21:13:58 user nova-compute[72992]:   <devices>
Aug 15 21:13:58 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:13:58 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:13:58 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk"/>
Aug 15 21:13:58 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:13:58 user nova-compute[72992]:     </disk>
Aug 15 21:13:58 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:13:58 user nova-compute[72992]:       <mac address="fa:16:3e:18:c5:8d"/>
Aug 15 21:13:58 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:58 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:13:58 user nova-compute[72992]:       <target dev="tap0f6e4fe9-7e"/>
Aug 15 21:13:58 user nova-compute[72992]:     </interface>
Aug 15 21:13:58 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:13:58 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/console.log" append="off"/>
Aug 15 21:13:58 user nova-compute[72992]:     </serial>
Aug 15 21:13:58 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:13:58 user nova-compute[72992]:     <video>
Aug 15 21:13:58 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:13:58 user nova-compute[72992]:     </video>
Aug 15 21:13:58 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:13:58 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:13:58 user nova-compute[72992]:     </rng>
Aug 15 21:13:58 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:13:58 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:13:58 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:13:58 user nova-compute[72992]:     </memballoon>
Aug 15 21:13:58 user nova-compute[72992]:   </devices>
Aug 15 21:13:58 user nova-compute[72992]: </domain>
Aug 15 21:13:58 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-987850189',display_name='tempest-TestVolumeSwap-server-987850189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-987850189',id=10,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLB6wVGQVbpUMWHv5g1RzSm/+1RmlbXCKK5oEcU0yvCbNH8YcTKWlkVhMqb1gzAPnKBSH5q2FfAG5tIuu+moO19ebHGf9PInf6aUP22yiGynu1wg5m7ElVVfEAMoLdWaw==',key_name='tempest-keypair-164681680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0aa5ec24cfc4e43935a90a8ac5cbe52',ramdisk_id='',reservation_id='r-podsb8zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1778895763',owner_user_name='tempest-TestVolumeSwap-1778895763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0188ea63e796441294fe121527359a12',uuid=bd51cb75-790e-4c23-8c48-a3de273b900f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Converting VIF {"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:c5:8d,bridge_name='br-int',has_traffic_filtering=True,id=0f6e4fe9-7e44-4003-90c7-54196c955c0d,network=Network(b4e6963b-327c-45a0-b17c-b28ebddefa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e4fe9-7e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG os_vif [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c5:8d,bridge_name='br-int',has_traffic_filtering=True,id=0f6e4fe9-7e44-4003-90c7-54196c955c0d,network=Network(b4e6963b-327c-45a0-b17c-b28ebddefa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e4fe9-7e') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f6e4fe9-7e, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f6e4fe9-7e, col_values=(('external_ids', {'iface-id': '0f6e4fe9-7e44-4003-90c7-54196c955c0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:c5:8d', 'vm-uuid': 'bd51cb75-790e-4c23-8c48-a3de273b900f'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:13:58 user nova-compute[72992]: INFO os_vif [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:c5:8d,bridge_name='br-int',has_traffic_filtering=True,id=0f6e4fe9-7e44-4003-90c7-54196c955c0d,network=Network(b4e6963b-327c-45a0-b17c-b28ebddefa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e4fe9-7e')
Aug 15 21:13:58 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Instance spawned successfully.
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:58 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134038.739054, 9bc3a41b-c56e-41db-9897-bd9f7554869d => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:13:58 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] VM Started (Lifecycle Event)
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:13:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] No VIF found with MAC fa:16:3e:18:c5:8d, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:13:58 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:13:59 user nova-compute[72992]: INFO nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Took 9.69 seconds to spawn the instance on the hypervisor.
Aug 15 21:13:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:13:59 user nova-compute[72992]: INFO nova.compute.manager [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Took 12.08 seconds to build instance.
Aug 15 21:13:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-72ac402d-131a-42f5-a945-aaa8df83afe4 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.387s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:13:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-81dcdfe8-2d3f-497e-a0dd-834a004128b3 req-1c81d6f7-d315-4948-8927-229b712798fa service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-81dcdfe8-2d3f-497e-a0dd-834a004128b3 req-1c81d6f7-d315-4948-8927-229b712798fa service nova] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-81dcdfe8-2d3f-497e-a0dd-834a004128b3 req-1c81d6f7-d315-4948-8927-229b712798fa service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-81dcdfe8-2d3f-497e-a0dd-834a004128b3 req-1c81d6f7-d315-4948-8927-229b712798fa service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-81dcdfe8-2d3f-497e-a0dd-834a004128b3 req-1c81d6f7-d315-4948-8927-229b712798fa service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] No waiting events found dispatching network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:00 user nova-compute[72992]: WARNING nova.compute.manager [req-81dcdfe8-2d3f-497e-a0dd-834a004128b3 req-1c81d6f7-d315-4948-8927-229b712798fa service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received unexpected event network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d for instance with vm_state building and task_state spawning.
Aug 15 21:14:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-b4d0b256-ba37-4091-aa3e-331914cb577e req-272ff331-55c1-48d7-85b2-7ec38003bab2 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b4d0b256-ba37-4091-aa3e-331914cb577e req-272ff331-55c1-48d7-85b2-7ec38003bab2 service nova] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b4d0b256-ba37-4091-aa3e-331914cb577e req-272ff331-55c1-48d7-85b2-7ec38003bab2 service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b4d0b256-ba37-4091-aa3e-331914cb577e req-272ff331-55c1-48d7-85b2-7ec38003bab2 service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-b4d0b256-ba37-4091-aa3e-331914cb577e req-272ff331-55c1-48d7-85b2-7ec38003bab2 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] No waiting events found dispatching network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:01 user nova-compute[72992]: WARNING nova.compute.manager [req-b4d0b256-ba37-4091-aa3e-331914cb577e req-272ff331-55c1-48d7-85b2-7ec38003bab2 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received unexpected event network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc for instance with vm_state active and task_state None.
Aug 15 21:14:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Skipping network cache update for instance because it is Building. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:14:01 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:14:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updating instance_info_cache with network_info: [{"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:14:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-c1d924d7-6c7e-45a6-bdf0-3882067c365d req-ec1820ca-7be7-4d4c-91b4-17001b548694 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c1d924d7-6c7e-45a6-bdf0-3882067c365d req-ec1820ca-7be7-4d4c-91b4-17001b548694 service nova] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c1d924d7-6c7e-45a6-bdf0-3882067c365d req-ec1820ca-7be7-4d4c-91b4-17001b548694 service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c1d924d7-6c7e-45a6-bdf0-3882067c365d req-ec1820ca-7be7-4d4c-91b4-17001b548694 service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-c1d924d7-6c7e-45a6-bdf0-3882067c365d req-ec1820ca-7be7-4d4c-91b4-17001b548694 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] No waiting events found dispatching network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:03 user nova-compute[72992]: WARNING nova.compute.manager [req-c1d924d7-6c7e-45a6-bdf0-3882067c365d req-ec1820ca-7be7-4d4c-91b4-17001b548694 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received unexpected event network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d for instance with vm_state building and task_state spawning.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] No waiting events found dispatching network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:03 user nova-compute[72992]: WARNING nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received unexpected event network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc for instance with vm_state active and task_state None.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:03 user nova-compute[72992]: WARNING nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state active and task_state None.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:03 user nova-compute[72992]: WARNING nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state active and task_state None.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:03 user nova-compute[72992]: WARNING nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received unexpected event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with vm_state active and task_state None.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:14:03 user nova-compute[72992]: WARNING nova.compute.manager [req-13469b64-024b-49fa-aeab-9f49674fb9fc req-bbc0c8af-b17c-4284-a997-11ef267b083a service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received unexpected event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with vm_state active and task_state None.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134043.6337564, bd51cb75-790e-4c23-8c48-a3de273b900f => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:14:03 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] VM Resumed (Lifecycle Event)
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:14:03 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Instance spawned successfully.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:14:03 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134043.6386604, bd51cb75-790e-4c23-8c48-a3de273b900f => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:14:03 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] VM Started (Lifecycle Event)
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:14:03 user nova-compute[72992]: INFO nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Took 8.63 seconds to spawn the instance on the hypervisor.
Aug 15 21:14:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:14:03 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:14:04 user nova-compute[72992]: INFO nova.compute.manager [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Took 10.61 seconds to build instance.
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bad9e0a-bae5-4ab7-aec9-0e96a4ee3345 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.787s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:14:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:14:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.888092041015625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:14:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 412a57dc-d6a0-44ec-a661-05fed5309955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 81bd731c-9957-41c5-9ecb-460870323a44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 9bc3a41b-c56e-41db-9897-bd9f7554869d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bd51cb75-790e-4c23-8c48-a3de273b900f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:14:10 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:14:11 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:14:11 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:14:11 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:14:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.490s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:14:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:14:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "828e251d-9717-494e-aea1-3d62a5942dfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:14:37 user nova-compute[72992]: INFO nova.compute.claims [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Claim successful on node user
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:14:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:14:37 user nova-compute[72992]: INFO nova.virt.block_device [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Booting with volume 8683c4df-8fd3-455b-9942-cdbc663ecc56 at /dev/vda
Aug 15 21:14:37 user nova-compute[72992]: DEBUG nova.policy [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c36d3f2446644c5ba5fd2faf9b924b08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bfe02b6711457a990c2e6ba01fd696', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:14:37 user nova-compute[72992]: DEBUG os_brick.utils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:14:37 user nova-compute[72992]: INFO oslo.privsep.daemon [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpz6234ocb/privsep.sock']
Aug 15 21:14:37 user sudo[84340]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpz6234ocb/privsep.sock
Aug 15 21:14:37 user sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 21:14:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully created port: 03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:14:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully created port: 4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully created port: b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:14:39 user sudo[84340]: pam_unix(sudo:session): session closed for user root
Aug 15 21:14:39 user nova-compute[72992]: INFO oslo.privsep.daemon [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Spawned new privsep daemon via rootwrap
Aug 15 21:14:39 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 21:14:39 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 21:14:39 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 21:14:39 user nova-compute[72992]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84389
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b196f696-697a-485d-b4b6-6a35aa5b15ae]: (2,) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b68ae05-0f81-4095-b7c8-d33e97b725f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:39 user nova-compute[72992]: WARNING os_brick.initiator.connectors.nvmeof [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e9689-341b-4bb0-bea3-3d725c347d24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d927f8-1c8b-4ed8-9e84-8aa5ee1f461c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab88c62-54c1-4c9f-9a57-1c0ab5ad72c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:14:39 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:14:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faee1fe-e362-4cdc-9826-6f0478fc4e58]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG os_brick.utils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== get_connector_properties: return (2134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:14:39 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating existing volume attachment record: 10c0ab4d-566a-4682-a81e-1cc545f93a75 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:14:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully created port: 5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:14:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully created port: 4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully updated port: 03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-03fb6381-c867-45c2-b4de-d9e88a8eb16c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG nova.network.neutron [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port 03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG nova.network.neutron [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:14:41 user nova-compute[72992]: DEBUG nova.network.neutron [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ef371175-80d8-4f12-b868-32bfd13eff13 req-dd2840b2-96e0-4daa-bb14-3b08830345be service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:42 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully updated port: c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully updated port: 3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-c53600fd-45c2-4d10-9473-6375047cbc02. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port 3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:14:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:14:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fedd3d2c-df20-4402-9c32-8f769b41a1d7 req-f3ebabfc-f5ef-43b6-b187-c47ef9faf8c2 service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully updated port: 4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully updated port: b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-4edc052c-926e-4df1-83ec-67da9a9e51db. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.network.neutron [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port 4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.network.neutron [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.network.neutron [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-b4e7b210-6454-41ce-9a2b-a5947d771863. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:45 user nova-compute[72992]: DEBUG nova.network.neutron [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:14:46 user nova-compute[72992]: DEBUG nova.network.neutron [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:14:46 user nova-compute[72992]: DEBUG nova.network.neutron [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4642b811-9cfc-4ef9-a6f2-9be4c79b37c6 req-e670612b-2e96-4279-8ded-5277a278196e service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:46 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully updated port: 5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Successfully updated port: 4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-5f51ad5d-343f-4a77-93d8-875526481090. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:14:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:14:49 user nova-compute[72992]: INFO nova.virt.block_device [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Booting with volume d0526857-d388-435a-afa4-eb74a7010025 at /dev/vdb
Aug 15 21:14:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0625d0ca-34d2-4302-93fd-941be295850a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58b9ee-9ca2-430c-89de-ad5be6168f95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd32db5-b3cc-43e9-a5c2-b1383b281efd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4f830-f5eb-4aab-a082-b4fcb3b4b9a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:14:49 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b0e796-28da-448b-b86f-f027269a957a]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating existing volume attachment record: 20c3ee98-f4bd-4683-b154-15f8d05a2b83 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.network.neutron [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance network_info: |[{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port 5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updated VIF entry in instance network info cache for port 5f51ad5d-343f-4a77-93d8-875526481090. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-4b762f30-2f54-43fb-8464-3b9c41dd316b. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:14:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port 4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:14:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updated VIF entry in instance network info cache for port 4b762f30-2f54-43fb-8464-3b9c41dd316b. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:14:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:14:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-002dc418-5e88-40ed-b769-c23366a9fd66 req-9d481eed-fbd7-494e-8b31-d3eeb59abc80 service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:14:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:14:58 user nova-compute[72992]: INFO nova.virt.block_device [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Booting with volume e51e87d8-edad-467c-9322-24660ad8eb8d at /dev/vdc
Aug 15 21:14:58 user nova-compute[72992]: DEBUG os_brick.utils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[af62db70-1fd7-4fd3-b45c-de276fb37350]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0252f159-06eb-4ffa-ae7f-01aa255b947b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f5ec0c-1dd4-4499-91d6-db40095394a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acfd15a-fbb2-450c-af23-e641ac273bd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:14:58 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:14:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2331850-77e5-4835-95a0-3a31c590f213]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG os_brick.utils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating existing volume attachment record: b5b19d97-c0ef-483b-9ea7-16219c586a0c {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:14:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:14:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:15:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:03 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:15:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updating instance_info_cache with network_info: [{"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:05 user nova-compute[72992]: INFO nova.compute.manager [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] instance snapshotting
Aug 15 21:15:05 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Beginning live snapshot process
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lazy-loading 'flavor' on Instance uuid b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnpw028dm/932c2dbe7a354a819f2a986ddee95c3a.delta 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnpw028dm/932c2dbe7a354a819f2a986ddee95c3a.delta 1073741824" returned: 0 in 0.047s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 21:15:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72992) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 21:15:06 user nova-compute[72992]: INFO nova.virt.libvirt.host [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] UEFI support detected
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:06 user nova-compute[72992]: INFO nova.compute.manager [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Attaching volume 2f2a43d1-278e-4b36-8dd9-8c9a66f0291b to /dev/vdb
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG os_brick.utils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c906e468-b025-4d43-bf7c-73a629fe9345]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed644d63-d009-4196-931f-e1a503630db8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e830753-1e79-4619-a504-b3597b6bea04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[46474552-721b-47ce-8fe6-dcdbed5336d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:07 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad12943-d87a-40ef-8f0e-1e5bc23aa860]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG os_brick.utils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updating existing volume attachment record: 2748f14c-9410-4064-ac69-665ed6cce807 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] COPY block job progress, current cursor: 327680 final cursor: 75497472 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:15:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 21:15:07 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnpw028dm/932c2dbe7a354a819f2a986ddee95c3a.delta /opt/stack/data/nova/instances/snapshots/tmpnpw028dm/932c2dbe7a354a819f2a986ddee95c3a {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:15:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Creating image(s)
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Ensure instance console log exists: /opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Start _get_guest_xml network_info=[{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrWbnTFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '828e251d-9717-494e-aea1-3d62a5942dfe', 'attached_at': '', 'detached_at': '', 'volume_id': '8683c4df-8fd3-455b-9942-cdbc663ecc56', 'serial': '8683c4df-8fd3-455b-9942-cdbc663ecc56'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '10c0ab4d-566a-4682-a81e-1cc545f93a75', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVgZxQGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '828e251d-9717-494e-aea1-3d62a5942dfe', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0526857-d388-435a-afa4-eb74a7010025', 'serial': 'd0526857-d388-435a-afa4-eb74a7010025'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '20c3ee98-f4bd-4683-b154-15f8d05a2b83', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cknRxTyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '828e251d-9717-494e-aea1-3d62a5942dfe', 'attached_at': '', 'detached_at': '', 'volume_id': 'e51e87d8-edad-467c-9322-24660ad8eb8d', 'serial': 'e51e87d8-edad-467c-9322-24660ad8eb8d'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'b5b19d97-c0ef-483b-9ea7-16219c586a0c', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connector [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Factory for ISCSI on None {{(pid=72992) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrWbnTFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:08 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:08 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:08 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a017011-b385-4511-b595-4ccdaa8dc23f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:08 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc7cf95-1cac-4c64-a9a0-8eee8f55c900]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56] added
Aug 15 21:15:08 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb6ff9f-7948-4faa-90ec-1dda6e5d5a0f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17db270-d88f-477b-a916-4a4dfc2b813f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrWbnTFi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jrWbnTFi" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf677da4-a18a-4dec-bbdf-4aae1003cf61]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jrWbnTFi'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[98012122-3cdc-437c-b777-f14ba666d7df]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[19122ff7-782a-4d47-9274-d5619109b823]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:15:08 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:15:08 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:08 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:15:08 user nova-compute[72992]: 
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnpw028dm/932c2dbe7a354a819f2a986ddee95c3a.delta /opt/stack/data/nova/instances/snapshots/tmpnpw028dm/932c2dbe7a354a819f2a986ddee95c3a" returned: 0 in 0.612s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Snapshot extracted, beginning image upload
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33635b8-1225-43a5-bce3-6d591df2df9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260]
Aug 15 21:15:08 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:08 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a561f-5471-4288-9eff-afde0502e703]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e05c759-fb64-412b-ae58-fb5bb46b5c2f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:08 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:08 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[407e8906-323c-4a83-aab9-08c9f593add9]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrWbnTFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:08 user nova-compute[72992]: INFO nova.compute.manager [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Rescuing
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:15:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.576s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== connect_volume: return (1578ms) {'type': 'block', 'scsi_wwn': '26435336531353866', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435336531353866', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-changed-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Refreshing instance network info cache due to event network-changed-25b5157e-6099-448c-af89-cc4477901f69. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] Acquiring lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] Acquired lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Refreshing network info cache for port 25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:15:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=6865MB free_disk=25.783340454101562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVgZxQGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:09 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:09 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:09 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[43605994-dcd6-48bf-9807-35e91b5c5659]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:09 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[254215a1-761e-461f-9f9d-ffaed7c9697d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025] added
Aug 15 21:15:09 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ed8ec-af8d-402f-9311-216821057ea7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a0b316-e604-4293-ba09-debb88b731b1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVgZxQGM {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVgZxQGM" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4210c2b5-6c73-425f-9f1d-1de175b23ba8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oVgZxQGM'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updating instance_info_cache with network_info: [{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 412a57dc-d6a0-44ec-a661-05fed5309955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 81bd731c-9957-41c5-9ecb-460870323a44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 9bc3a41b-c56e-41db-9897-bd9f7554869d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bd51cb75-790e-4c23-8c48-a3de273b900f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 828e251d-9717-494e-aea1-3d62a5942dfe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee4e4c-8306-4d99-8679-13853cdc016e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b68877e-839b-4319-8e5e-ec706520f6fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50845284-f76f-481c-985b-c0ca2bd1e38a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260]
Aug 15 21:15:10 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[29808592-fe8d-40bb-bff0-c377dbb696ab]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ff5fe6-91f0-450d-adf0-33e085278a48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:10 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:10 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5d3458-98de-41f9-91bd-af6daa65f876]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVgZxQGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.822s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-0d74c3db-920d-4f8b-9b5e-e58e9978f0b3 req-42353c5b-420a-40a6-81e5-edbb96cd64c4 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-unplugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0d74c3db-920d-4f8b-9b5e-e58e9978f0b3 req-42353c5b-420a-40a6-81e5-edbb96cd64c4 service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0d74c3db-920d-4f8b-9b5e-e58e9978f0b3 req-42353c5b-420a-40a6-81e5-edbb96cd64c4 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0d74c3db-920d-4f8b-9b5e-e58e9978f0b3 req-42353c5b-420a-40a6-81e5-edbb96cd64c4 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-0d74c3db-920d-4f8b-9b5e-e58e9978f0b3 req-42353c5b-420a-40a6-81e5-edbb96cd64c4 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-unplugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:10 user nova-compute[72992]: WARNING nova.compute.manager [req-0d74c3db-920d-4f8b-9b5e-e58e9978f0b3 req-42353c5b-420a-40a6-81e5-edbb96cd64c4 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received unexpected event network-vif-unplugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with vm_state active and task_state rescuing.
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:15:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance destroyed successfully.
Aug 15 21:15:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Attempting rescue
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72992) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:15:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Creating image(s)
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'trusted_certs' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23035363065376434', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035363065376434', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updated VIF entry in instance network info cache for port 25b5157e-6099-448c-af89-cc4477901f69. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating instance_info_cache with network_info: [{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cknRxTyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:11 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:11 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:11 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2c72c24b-cca1-491d-91ff-1a7673b49bd0 req-f1a72280-0de6-41d8-8b9f-8536692e990d service nova] Releasing lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c3b6c2-d838-492b-83ea-08b3e20cea76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:11 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ddf319-466f-49f1-b7ba-e2d975d59463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d] added
Aug 15 21:15:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.246s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6781ffa7-c94f-4b98-a4c6-d3d4a3e6222b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue" returned: 0 in 0.062s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'migration_context' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aabc5c-0494-4ca7-8936-be7ec3b9dadd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Start _get_guest_xml network_info=[{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:97:bb:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'resources' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cknRxTyD {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cknRxTyD" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bdd3fc-63ea-4569-96af-46bef7019411]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cknRxTyD'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'numa_topology' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fa0c02-8a0b-454f-91c6-6b28d0f29d14]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:11 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'vcpu_model' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce06b05-0a11-47ce-b6bc-3dc38cae600c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1286787809',display_name='tempest-ServerRescueNegativeTestJSON-server-1286787809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1286787809',id=6,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-hocp9kpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:45Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=e52158f6-519d-4a8f-99d6-756e64385366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:97:bb:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:97:bb:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'pci_devices' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d19704-7579-42ff-9e61-dbd9790326a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260]
Aug 15 21:15:11 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:15:11 user nova-compute[72992]:   <uuid>e52158f6-519d-4a8f-99d6-756e64385366</uuid>
Aug 15 21:15:11 user nova-compute[72992]:   <name>instance-00000006</name>
Aug 15 21:15:11 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:15:11 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:15:11 user nova-compute[72992]:   <metadata>
Aug 15 21:15:11 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:15:11 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:15:11 user nova-compute[72992]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1286787809</nova:name>
Aug 15 21:15:11 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:15:11</nova:creationTime>
Aug 15 21:15:11 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:15:11 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:15:11 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:15:11 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:15:11 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:15:11 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:15:11 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:15:11 user nova-compute[72992]:       <nova:owner>
Aug 15 21:15:11 user nova-compute[72992]:         <nova:user uuid="08a032f1741f46ee814186f61b82aac4">tempest-ServerRescueNegativeTestJSON-600517153-project-member</nova:user>
Aug 15 21:15:11 user nova-compute[72992]:         <nova:project uuid="664606f930f446fabae71df899c94da5">tempest-ServerRescueNegativeTestJSON-600517153</nova:project>
Aug 15 21:15:11 user nova-compute[72992]:       </nova:owner>
Aug 15 21:15:11 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:15:11 user nova-compute[72992]:       <nova:ports>
Aug 15 21:15:11 user nova-compute[72992]:         <nova:port uuid="0e7c808f-e1b0-4b77-a5e8-818aa10f314c">
Aug 15 21:15:11 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:15:11 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:11 user nova-compute[72992]:       </nova:ports>
Aug 15 21:15:11 user nova-compute[72992]:     </nova:instance>
Aug 15 21:15:11 user nova-compute[72992]:   </metadata>
Aug 15 21:15:11 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:15:11 user nova-compute[72992]:     <system>
Aug 15 21:15:11 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:15:11 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:15:11 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:15:11 user nova-compute[72992]:       <entry name="serial">e52158f6-519d-4a8f-99d6-756e64385366</entry>
Aug 15 21:15:11 user nova-compute[72992]:       <entry name="uuid">e52158f6-519d-4a8f-99d6-756e64385366</entry>
Aug 15 21:15:11 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:15:11 user nova-compute[72992]:     </system>
Aug 15 21:15:11 user nova-compute[72992]:   </sysinfo>
Aug 15 21:15:11 user nova-compute[72992]:   <os>
Aug 15 21:15:11 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:15:11 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:15:11 user nova-compute[72992]:   </os>
Aug 15 21:15:11 user nova-compute[72992]:   <features>
Aug 15 21:15:11 user nova-compute[72992]:     <acpi/>
Aug 15 21:15:11 user nova-compute[72992]:     <apic/>
Aug 15 21:15:11 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:15:11 user nova-compute[72992]:   </features>
Aug 15 21:15:11 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:15:11 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:15:11 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:15:11 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:15:11 user nova-compute[72992]:   </clock>
Aug 15 21:15:11 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:15:11 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:15:11 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:15:11 user nova-compute[72992]:   </cpu>
Aug 15 21:15:11 user nova-compute[72992]:   <devices>
Aug 15 21:15:11 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:15:11 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:15:11 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue"/>
Aug 15 21:15:11 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:15:11 user nova-compute[72992]:     </disk>
Aug 15 21:15:11 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:15:11 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:15:11 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk"/>
Aug 15 21:15:11 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:15:11 user nova-compute[72992]:     </disk>
Aug 15 21:15:11 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:11 user nova-compute[72992]:       <mac address="fa:16:3e:97:bb:5a"/>
Aug 15 21:15:11 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:11 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:11 user nova-compute[72992]:       <target dev="tap0e7c808f-e1"/>
Aug 15 21:15:11 user nova-compute[72992]:     </interface>
Aug 15 21:15:11 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:15:11 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/console.log" append="off"/>
Aug 15 21:15:11 user nova-compute[72992]:     </serial>
Aug 15 21:15:11 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:15:11 user nova-compute[72992]:     <video>
Aug 15 21:15:11 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:11 user nova-compute[72992]:     </video>
Aug 15 21:15:11 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:15:11 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:15:11 user nova-compute[72992]:     </rng>
Aug 15 21:15:11 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:15:11 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:15:11 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:15:11 user nova-compute[72992]:     </memballoon>
Aug 15 21:15:11 user nova-compute[72992]:   </devices>
Aug 15 21:15:11 user nova-compute[72992]: </domain>
Aug 15 21:15:11 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[43362ecf-9968-415c-a64b-3ecc84b22978]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance destroyed successfully.
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63820d9-b1d8-4385-a11a-73e630e187b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:11 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c848e1cb-efc7-4c02-aee1-a374c5c4814f]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cknRxTyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No VIF found with MAC fa:16:3e:97:bb:5a, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:12 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Snapshot image upload complete
Aug 15 21:15:12 user nova-compute[72992]: INFO nova.compute.manager [None req-9b764fc4-8724-4968-a672-e945e1ba23af tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Took 6.82 seconds to snapshot the instance on the hypervisor.
Aug 15 21:15:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '26566643765393066', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566643765393066', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing instance network info cache due to event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.neutron [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=03fb6381-c867-45c2-b4de-d9e88a8eb16c,network=Network(58730ee3-ec6d-496a-94fc-e82e0ba298d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fb6381-c8') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:03:c1,bridge_name='br-int',has_traffic_filtering=True,id=c53600fd-45c2-4d10-9473-6375047cbc02,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc53600fd-45') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:6f,bridge_name='br-int',has_traffic_filtering=True,id=3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b4e4fcd-7b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:92:3b,bridge_name='br-int',has_traffic_filtering=True,id=4edc052c-926e-4df1-83ec-67da9a9e51db,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edc052c-92') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:b2:82,bridge_name='br-int',has_traffic_filtering=True,id=b4e7b210-6454-41ce-9a2b-a5947d771863,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4e7b210-64') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:46:77,bridge_name='br-int',has_traffic_filtering=True,id=5f51ad5d-343f-4a77-93d8-875526481090,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f51ad5d-34') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a6:31,bridge_name='br-int',has_traffic_filtering=True,id=4b762f30-2f54-43fb-8464-3b9c41dd316b,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b762f30-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.objects.instance [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lazy-loading 'pci_devices' on Instance uuid 828e251d-9717-494e-aea1-3d62a5942dfe {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:15:12 user nova-compute[72992]:   <uuid>828e251d-9717-494e-aea1-3d62a5942dfe</uuid>
Aug 15 21:15:12 user nova-compute[72992]:   <name>instance-0000000b</name>
Aug 15 21:15:12 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:15:12 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:15:12 user nova-compute[72992]:   <metadata>
Aug 15 21:15:12 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:15:12 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:15:12 user nova-compute[72992]:       <nova:name>tempest-device-tagging-server-1162800973</nova:name>
Aug 15 21:15:12 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:15:08</nova:creationTime>
Aug 15 21:15:12 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:15:12 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:15:12 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:15:12 user nova-compute[72992]:       <nova:owner>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:user uuid="c36d3f2446644c5ba5fd2faf9b924b08">tempest-TaggedBootDevicesTest_v242-1818994412-project-member</nova:user>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:project uuid="d7bfe02b6711457a990c2e6ba01fd696">tempest-TaggedBootDevicesTest_v242-1818994412</nova:project>
Aug 15 21:15:12 user nova-compute[72992]:       </nova:owner>
Aug 15 21:15:12 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:15:12 user nova-compute[72992]:       <nova:ports>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:port uuid="03fb6381-c867-45c2-b4de-d9e88a8eb16c">
Aug 15 21:15:12 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 21:15:12 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:port uuid="c53600fd-45c2-4d10-9473-6375047cbc02">
Aug 15 21:15:12 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Aug 15 21:15:12 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:port uuid="3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78">
Aug 15 21:15:12 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Aug 15 21:15:12 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:port uuid="4edc052c-926e-4df1-83ec-67da9a9e51db">
Aug 15 21:15:12 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.247" ipVersion="4"/>
Aug 15 21:15:12 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:port uuid="b4e7b210-6454-41ce-9a2b-a5947d771863">
Aug 15 21:15:12 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Aug 15 21:15:12 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:port uuid="5f51ad5d-343f-4a77-93d8-875526481090">
Aug 15 21:15:12 user nova-compute[72992]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 21:15:12 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:12 user nova-compute[72992]:         <nova:port uuid="4b762f30-2f54-43fb-8464-3b9c41dd316b">
Aug 15 21:15:12 user nova-compute[72992]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 21:15:12 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:12 user nova-compute[72992]:       </nova:ports>
Aug 15 21:15:12 user nova-compute[72992]:     </nova:instance>
Aug 15 21:15:12 user nova-compute[72992]:   </metadata>
Aug 15 21:15:12 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:15:12 user nova-compute[72992]:     <system>
Aug 15 21:15:12 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:15:12 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:15:12 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:15:12 user nova-compute[72992]:       <entry name="serial">828e251d-9717-494e-aea1-3d62a5942dfe</entry>
Aug 15 21:15:12 user nova-compute[72992]:       <entry name="uuid">828e251d-9717-494e-aea1-3d62a5942dfe</entry>
Aug 15 21:15:12 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:15:12 user nova-compute[72992]:     </system>
Aug 15 21:15:12 user nova-compute[72992]:   </sysinfo>
Aug 15 21:15:12 user nova-compute[72992]:   <os>
Aug 15 21:15:12 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:15:12 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:15:12 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:15:12 user nova-compute[72992]:   </os>
Aug 15 21:15:12 user nova-compute[72992]:   <features>
Aug 15 21:15:12 user nova-compute[72992]:     <acpi/>
Aug 15 21:15:12 user nova-compute[72992]:     <apic/>
Aug 15 21:15:12 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:15:12 user nova-compute[72992]:   </features>
Aug 15 21:15:12 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:15:12 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:15:12 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:15:12 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:15:12 user nova-compute[72992]:   </clock>
Aug 15 21:15:12 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:15:12 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:15:12 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:15:12 user nova-compute[72992]:   </cpu>
Aug 15 21:15:12 user nova-compute[72992]:   <devices>
Aug 15 21:15:12 user nova-compute[72992]:     <disk type="file" device="cdrom">
Aug 15 21:15:12 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 21:15:12 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe/disk.config"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="hda" bus="ide"/>
Aug 15 21:15:12 user nova-compute[72992]:     </disk>
Aug 15 21:15:12 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:15:12 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:12 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <serial>8683c4df-8fd3-455b-9942-cdbc663ecc56</serial>
Aug 15 21:15:12 user nova-compute[72992]:     </disk>
Aug 15 21:15:12 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:15:12 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:12 user nova-compute[72992]:       <source dev="/dev/sdc"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <serial>d0526857-d388-435a-afa4-eb74a7010025</serial>
Aug 15 21:15:12 user nova-compute[72992]:     </disk>
Aug 15 21:15:12 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:15:12 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:12 user nova-compute[72992]:       <source dev="/dev/sdd"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="vdc" bus="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <serial>e51e87d8-edad-467c-9322-24660ad8eb8d</serial>
Aug 15 21:15:12 user nova-compute[72992]:     </disk>
Aug 15 21:15:12 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:12 user nova-compute[72992]:       <mac address="fa:16:3e:cd:7d:8e"/>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="tap03fb6381-c8"/>
Aug 15 21:15:12 user nova-compute[72992]:     </interface>
Aug 15 21:15:12 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:12 user nova-compute[72992]:       <mac address="fa:16:3e:ce:03:c1"/>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="tapc53600fd-45"/>
Aug 15 21:15:12 user nova-compute[72992]:     </interface>
Aug 15 21:15:12 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:12 user nova-compute[72992]:       <mac address="fa:16:3e:5e:58:6f"/>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="tap3b4e4fcd-7b"/>
Aug 15 21:15:12 user nova-compute[72992]:     </interface>
Aug 15 21:15:12 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:12 user nova-compute[72992]:       <mac address="fa:16:3e:5c:92:3b"/>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="tap4edc052c-92"/>
Aug 15 21:15:12 user nova-compute[72992]:     </interface>
Aug 15 21:15:12 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:12 user nova-compute[72992]:       <mac address="fa:16:3e:dc:b2:82"/>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="tapb4e7b210-64"/>
Aug 15 21:15:12 user nova-compute[72992]:     </interface>
Aug 15 21:15:12 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:12 user nova-compute[72992]:       <mac address="fa:16:3e:f5:46:77"/>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="tap5f51ad5d-34"/>
Aug 15 21:15:12 user nova-compute[72992]:     </interface>
Aug 15 21:15:12 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:12 user nova-compute[72992]:       <mac address="fa:16:3e:55:a6:31"/>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:12 user nova-compute[72992]:       <target dev="tap4b762f30-2f"/>
Aug 15 21:15:12 user nova-compute[72992]:     </interface>
Aug 15 21:15:12 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:15:12 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe/console.log" append="off"/>
Aug 15 21:15:12 user nova-compute[72992]:     </serial>
Aug 15 21:15:12 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:15:12 user nova-compute[72992]:     <video>
Aug 15 21:15:12 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:12 user nova-compute[72992]:     </video>
Aug 15 21:15:12 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:15:12 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:15:12 user nova-compute[72992]:     </rng>
Aug 15 21:15:12 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:15:12 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:15:12 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:15:12 user nova-compute[72992]:     </memballoon>
Aug 15 21:15:12 user nova-compute[72992]:   </devices>
Aug 15 21:15:12 user nova-compute[72992]: </domain>
Aug 15 21:15:12 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=03fb6381-c867-45c2-b4de-d9e88a8eb16c,network=Network(58730ee3-ec6d-496a-94fc-e82e0ba298d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fb6381-c8') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=03fb6381-c867-45c2-b4de-d9e88a8eb16c,network=Network(58730ee3-ec6d-496a-94fc-e82e0ba298d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fb6381-c8') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03fb6381-c8, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03fb6381-c8, col_values=(('external_ids', {'iface-id': '03fb6381-c867-45c2-b4de-d9e88a8eb16c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:7d:8e', 'vm-uuid': '828e251d-9717-494e-aea1-3d62a5942dfe'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:12 user nova-compute[72992]: INFO os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=03fb6381-c867-45c2-b4de-d9e88a8eb16c,network=Network(58730ee3-ec6d-496a-94fc-e82e0ba298d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fb6381-c8')
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:03:c1,bridge_name='br-int',has_traffic_filtering=True,id=c53600fd-45c2-4d10-9473-6375047cbc02,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc53600fd-45') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:03:c1,bridge_name='br-int',has_traffic_filtering=True,id=c53600fd-45c2-4d10-9473-6375047cbc02,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc53600fd-45') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc53600fd-45, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc53600fd-45, col_values=(('external_ids', {'iface-id': 'c53600fd-45c2-4d10-9473-6375047cbc02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:03:c1', 'vm-uuid': '828e251d-9717-494e-aea1-3d62a5942dfe'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: INFO os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:03:c1,bridge_name='br-int',has_traffic_filtering=True,id=c53600fd-45c2-4d10-9473-6375047cbc02,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc53600fd-45')
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:6f,bridge_name='br-int',has_traffic_filtering=True,id=3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b4e4fcd-7b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:6f,bridge_name='br-int',has_traffic_filtering=True,id=3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b4e4fcd-7b') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b4e4fcd-7b, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b4e4fcd-7b, col_values=(('external_ids', {'iface-id': '3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:58:6f', 'vm-uuid': '828e251d-9717-494e-aea1-3d62a5942dfe'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: INFO os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:6f,bridge_name='br-int',has_traffic_filtering=True,id=3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b4e4fcd-7b')
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:92:3b,bridge_name='br-int',has_traffic_filtering=True,id=4edc052c-926e-4df1-83ec-67da9a9e51db,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edc052c-92') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:92:3b,bridge_name='br-int',has_traffic_filtering=True,id=4edc052c-926e-4df1-83ec-67da9a9e51db,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edc052c-92') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4edc052c-92, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4edc052c-92, col_values=(('external_ids', {'iface-id': '4edc052c-926e-4df1-83ec-67da9a9e51db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:92:3b', 'vm-uuid': '828e251d-9717-494e-aea1-3d62a5942dfe'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: INFO os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:92:3b,bridge_name='br-int',has_traffic_filtering=True,id=4edc052c-926e-4df1-83ec-67da9a9e51db,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edc052c-92')
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:b2:82,bridge_name='br-int',has_traffic_filtering=True,id=b4e7b210-6454-41ce-9a2b-a5947d771863,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4e7b210-64') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:b2:82,bridge_name='br-int',has_traffic_filtering=True,id=b4e7b210-6454-41ce-9a2b-a5947d771863,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4e7b210-64') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4e7b210-64, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4e7b210-64, col_values=(('external_ids', {'iface-id': 'b4e7b210-6454-41ce-9a2b-a5947d771863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:b2:82', 'vm-uuid': '828e251d-9717-494e-aea1-3d62a5942dfe'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: INFO os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:b2:82,bridge_name='br-int',has_traffic_filtering=True,id=b4e7b210-6454-41ce-9a2b-a5947d771863,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4e7b210-64')
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:46:77,bridge_name='br-int',has_traffic_filtering=True,id=5f51ad5d-343f-4a77-93d8-875526481090,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f51ad5d-34') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:46:77,bridge_name='br-int',has_traffic_filtering=True,id=5f51ad5d-343f-4a77-93d8-875526481090,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f51ad5d-34') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:13 user nova-compute[72992]: INFO nova.compute.manager [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] instance snapshotting
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f51ad5d-34, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f51ad5d-34, col_values=(('external_ids', {'iface-id': '5f51ad5d-343f-4a77-93d8-875526481090', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:46:77', 'vm-uuid': '828e251d-9717-494e-aea1-3d62a5942dfe'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: INFO os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:46:77,bridge_name='br-int',has_traffic_filtering=True,id=5f51ad5d-343f-4a77-93d8-875526481090,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f51ad5d-34')
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a6:31,bridge_name='br-int',has_traffic_filtering=True,id=4b762f30-2f54-43fb-8464-3b9c41dd316b,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b762f30-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a6:31,bridge_name='br-int',has_traffic_filtering=True,id=4b762f30-2f54-43fb-8464-3b9c41dd316b,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b762f30-2f') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b762f30-2f, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b762f30-2f, col_values=(('external_ids', {'iface-id': '4b762f30-2f54-43fb-8464-3b9c41dd316b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:a6:31', 'vm-uuid': '828e251d-9717-494e-aea1-3d62a5942dfe'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Beginning live snapshot process
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: INFO os_vif [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a6:31,bridge_name='br-int',has_traffic_filtering=True,id=4b762f30-2f54-43fb-8464-3b9c41dd316b,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b762f30-2f')
Aug 15 21:15:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] No BDM found with device name hda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] No VIF found with MAC fa:16:3e:cd:7d:8e, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] No VIF found with MAC fa:16:3e:dc:b2:82, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Using config drive
Aug 15 21:15:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json -f qcow2" returned: 0 in 0.268s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:14 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Creating config drive at /opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe/disk.config
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp87dssggt {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updated VIF entry in instance network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp87dssggt" returned: 0 in 0.113s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:14 user nova-compute[72992]: WARNING nova.compute.manager [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received unexpected event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with vm_state active and task_state rescuing.
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-changed-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Refreshing instance network info cache due to event network-changed-af2b7efa-961f-4412-923a-4698c8b198bc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Acquiring lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Acquired lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Refreshing network info cache for port af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5gw67mli/01513d2fccaf4e588689cea9bda516f3.delta 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5gw67mli/01513d2fccaf4e588689cea9bda516f3.delta 1073741824" returned: 0 in 0.060s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:14 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Updated VIF entry in instance network info cache for port af2b7efa-961f-4412-923a-4698c8b198bc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Updating instance_info_cache with network_info: [{"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-247d3c43-d296-4528-a83d-f480e518e4ec req-80525ca0-09a7-47c6-9512-82170026cab3 service nova] Releasing lock "refresh_cache-412a57dc-d6a0-44ec-a661-05fed5309955" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:14 user nova-compute[72992]: WARNING nova.compute.manager [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received unexpected event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with vm_state active and task_state rescuing.
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:14 user nova-compute[72992]: WARNING nova.compute.manager [req-596e0853-daa7-4c3d-8b65-99e51639d7b4 req-a03064cf-afc6-4161-8daf-04d50eeddc02 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received unexpected event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with vm_state active and task_state rescuing.
Aug 15 21:15:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:15 user nova-compute[72992]: DEBUG nova.objects.instance [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:15:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for e52158f6-519d-4a8f-99d6-756e64385366 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134116.0052762, e52158f6-519d-4a8f-99d6-756e64385366 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:16 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] VM Resumed (Lifecycle Event)
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:16 user nova-compute[72992]: INFO nova.compute.manager [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Attaching volume ef79e12b-68d1-4205-845d-a38866af8722 to /dev/vdb
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-307fc9c8-74dd-4cb0-84ef-c8d45da5d6af tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:15:16 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134116.0129757, e52158f6-519d-4a8f-99d6-756e64385366 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:16 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] VM Started (Lifecycle Event)
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG os_brick.utils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df253e7-ff41-449a-b79a-96193e6d4252]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f2f6f6-f809-47aa-a483-04c022197066]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[33168d7e-9a47-46bb-84d9-be846d1cb693]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1290f8b4-84f1-4f8e-a4c9-acf3e2d35130]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:15:16 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:16 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b40d59-f4d7-4ebd-ad34-cfc2c9a15d9a]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG os_brick.utils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating existing volume attachment record: 0eb38560-15cb-4e14-9adc-170db072f167 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5gw67mli/01513d2fccaf4e588689cea9bda516f3.delta /opt/stack/data/nova/instances/snapshots/tmp5gw67mli/01513d2fccaf4e588689cea9bda516f3 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5gw67mli/01513d2fccaf4e588689cea9bda516f3.delta /opt/stack/data/nova/instances/snapshots/tmp5gw67mli/01513d2fccaf4e588689cea9bda516f3" returned: 0 in 0.461s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:16 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Snapshot extracted, beginning image upload
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [req-20821dba-2da5-4e93-a547-866b16d51125 req-8fdc1de6-8c87-4db1-b881-feb979aafc6e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-20821dba-2da5-4e93-a547-866b16d51125 req-8fdc1de6-8c87-4db1-b881-feb979aafc6e service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-20821dba-2da5-4e93-a547-866b16d51125 req-8fdc1de6-8c87-4db1-b881-feb979aafc6e service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-20821dba-2da5-4e93-a547-866b16d51125 req-8fdc1de6-8c87-4db1-b881-feb979aafc6e service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [req-20821dba-2da5-4e93-a547-866b16d51125 req-8fdc1de6-8c87-4db1-b881-feb979aafc6e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:16 user nova-compute[72992]: WARNING nova.compute.manager [req-20821dba-2da5-4e93-a547-866b16d51125 req-8fdc1de6-8c87-4db1-b881-feb979aafc6e service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c for instance with vm_state building and task_state spawning.
Aug 15 21:15:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-f81b1f5c-7bc4-451f-9f65-fe81789faeab req-0ac20dfa-a1ea-42e3-96cf-1c94f54ee324 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f81b1f5c-7bc4-451f-9f65-fe81789faeab req-0ac20dfa-a1ea-42e3-96cf-1c94f54ee324 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f81b1f5c-7bc4-451f-9f65-fe81789faeab req-0ac20dfa-a1ea-42e3-96cf-1c94f54ee324 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f81b1f5c-7bc4-451f-9f65-fe81789faeab req-0ac20dfa-a1ea-42e3-96cf-1c94f54ee324 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-f81b1f5c-7bc4-451f-9f65-fe81789faeab req-0ac20dfa-a1ea-42e3-96cf-1c94f54ee324 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:17 user nova-compute[72992]: WARNING nova.compute.manager [req-f81b1f5c-7bc4-451f-9f65-fe81789faeab req-0ac20dfa-a1ea-42e3-96cf-1c94f54ee324 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 for instance with vm_state building and task_state spawning.
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-ff1ef132-f09f-47db-959d-40fe53d8999c req-cf6ff1e7-c8ab-49e8-86fd-548cdd42bf3d service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ff1ef132-f09f-47db-959d-40fe53d8999c req-cf6ff1e7-c8ab-49e8-86fd-548cdd42bf3d service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ff1ef132-f09f-47db-959d-40fe53d8999c req-cf6ff1e7-c8ab-49e8-86fd-548cdd42bf3d service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ff1ef132-f09f-47db-959d-40fe53d8999c req-cf6ff1e7-c8ab-49e8-86fd-548cdd42bf3d service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-ff1ef132-f09f-47db-959d-40fe53d8999c req-cf6ff1e7-c8ab-49e8-86fd-548cdd42bf3d service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:17 user nova-compute[72992]: WARNING nova.compute.manager [req-ff1ef132-f09f-47db-959d-40fe53d8999c req-cf6ff1e7-c8ab-49e8-86fd-548cdd42bf3d service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db for instance with vm_state building and task_state spawning.
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG nova.objects.instance [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid 412a57dc-d6a0-44ec-a661-05fed5309955 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:18 user nova-compute[72992]: INFO nova.compute.manager [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Attaching volume b22eee57-a519-4312-88c2-56ce3ce936c7 to /dev/vdb
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:18 user nova-compute[72992]: WARNING nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c for instance with vm_state building and task_state spawning.
Aug 15 21:15:18 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:18 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:18 user nova-compute[72992]: WARNING nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 for instance with vm_state building and task_state spawning.
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 for instance with vm_state building and task_state spawning.
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 for instance with vm_state building and task_state spawning.
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 for instance with vm_state building and task_state spawning.
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING nova.compute.manager [req-107464a9-e86c-4bdc-8bb2-04a70a7abb60 req-02a75d2c-80bb-4174-8523-a9f2ed9d1f53 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 for instance with vm_state building and task_state spawning.
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.utils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff5051c-de48-44c0-ad16-07c8806cf134]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1232c4-9b7f-4635-873b-c2c81fa99503]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed391fdb-2558-43a8-90fc-1103618d884f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ca4113-60ab-47fd-a0cb-69a373ffcf22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f91d4a-d4fd-417a-a661-3375dabfef84]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.utils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Updating existing volume attachment record: 1121efc7-0c61-407e-940c-c00f2f9ed00b {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLbKWuVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:19 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING nova.compute.manager [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 for instance with vm_state building and task_state spawning.
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING nova.compute.manager [req-b174b255-07ff-4481-b96b-85ac7335ba6a req-99f8ec6f-aa50-47ed-a74c-6629acc24088 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b for instance with vm_state building and task_state spawning.
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3a317a-b930-40ad-b56c-4f0d6858a35b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:19 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6804d95-0789-4b6f-8c08-3f8bbe85ba9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b] added
Aug 15 21:15:19 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d2515e-789f-4c7c-8651-185332d0a637]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca3ecf9-33a9-4d90-b12e-1b1aec44ade3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLbKWuVo {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLbKWuVo" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36daf7e-922c-42d7-80b1-c0ec07a83877]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wLbKWuVo'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6521b93-39db-4228-96fb-3f16a5008861]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a323376d-f8f1-4922-ada4-3829521e8fe9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:19 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:19 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e210dd6f-ad65-4220-a909-6977481c8f9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260]
Aug 15 21:15:19 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:19 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[556dc6f2-7029-41c9-8a92-e0023a2a27ea]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb86c8-3e4f-4a2c-b64d-0056fc278e9f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b (non-flash)
Aug 15 21:15:19 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:19 user nova-compute[72992]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b (non-flash)
Aug 15 21:15:19 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c60b87e-5eec-4566-8509-b355a8197e60]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLbKWuVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-bfcc60ff-f71e-4c8e-ba22-c4e99254119f req-e2f3ff6a-d8e3-4b7a-aebd-30febfc7743b service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bfcc60ff-f71e-4c8e-ba22-c4e99254119f req-e2f3ff6a-d8e3-4b7a-aebd-30febfc7743b service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bfcc60ff-f71e-4c8e-ba22-c4e99254119f req-e2f3ff6a-d8e3-4b7a-aebd-30febfc7743b service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bfcc60ff-f71e-4c8e-ba22-c4e99254119f req-e2f3ff6a-d8e3-4b7a-aebd-30febfc7743b service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-bfcc60ff-f71e-4c8e-ba22-c4e99254119f req-e2f3ff6a-d8e3-4b7a-aebd-30febfc7743b service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:19 user nova-compute[72992]: WARNING nova.compute.manager [req-bfcc60ff-f71e-4c8e-ba22-c4e99254119f req-e2f3ff6a-d8e3-4b7a-aebd-30febfc7743b service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db for instance with vm_state building and task_state spawning.
Aug 15 21:15:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:20 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Snapshot image upload complete
Aug 15 21:15:20 user nova-compute[72992]: INFO nova.compute.manager [None req-c90eeba5-a398-4909-a2f0-1c43f8be5d97 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Took 7.52 seconds to snapshot the instance on the hypervisor.
Aug 15 21:15:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23061336565656166', 'path': '/dev/sde'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061336565656166', 'path': '/dev/sde'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lazy-loading 'flavor' on Instance uuid b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:15:20 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:20 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:15:20 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:15:20 user nova-compute[72992]:   <serial>2f2a43d1-278e-4b36-8dd9-8c9a66f0291b</serial>
Aug 15 21:15:20 user nova-compute[72992]: </disk>
Aug 15 21:15:20 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-1bf92dc3-7962-4924-8630-b2116ede8b02 req-23f8431a-615a-4be7-9dfb-cf7f494a0c2d service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1bf92dc3-7962-4924-8630-b2116ede8b02 req-23f8431a-615a-4be7-9dfb-cf7f494a0c2d service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1bf92dc3-7962-4924-8630-b2116ede8b02 req-23f8431a-615a-4be7-9dfb-cf7f494a0c2d service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1bf92dc3-7962-4924-8630-b2116ede8b02 req-23f8431a-615a-4be7-9dfb-cf7f494a0c2d service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-1bf92dc3-7962-4924-8630-b2116ede8b02 req-23f8431a-615a-4be7-9dfb-cf7f494a0c2d service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:21 user nova-compute[72992]: WARNING nova.compute.manager [req-1bf92dc3-7962-4924-8630-b2116ede8b02 req-23f8431a-615a-4be7-9dfb-cf7f494a0c2d service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 for instance with vm_state building and task_state spawning.
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134121.2743576, 828e251d-9717-494e-aea1-3d62a5942dfe => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] VM Resumed (Lifecycle Event)
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:15:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance spawned successfully.
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134121.2784803, 828e251d-9717-494e-aea1-3d62a5942dfe => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] VM Started (Lifecycle Event)
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] No VIF found with MAC fa:16:3e:50:a1:99, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:15:21 user nova-compute[72992]: INFO nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Took 13.43 seconds to spawn the instance on the hypervisor.
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-11722e55-922f-4d80-8cb8-6d0d42002bd9 req-dcf13c0f-a797-4616-9ce3-d1cd79dde4e9 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-11722e55-922f-4d80-8cb8-6d0d42002bd9 req-dcf13c0f-a797-4616-9ce3-d1cd79dde4e9 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-11722e55-922f-4d80-8cb8-6d0d42002bd9 req-dcf13c0f-a797-4616-9ce3-d1cd79dde4e9 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-11722e55-922f-4d80-8cb8-6d0d42002bd9 req-dcf13c0f-a797-4616-9ce3-d1cd79dde4e9 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-11722e55-922f-4d80-8cb8-6d0d42002bd9 req-dcf13c0f-a797-4616-9ce3-d1cd79dde4e9 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:21 user nova-compute[72992]: WARNING nova.compute.manager [req-11722e55-922f-4d80-8cb8-6d0d42002bd9 req-dcf13c0f-a797-4616-9ce3-d1cd79dde4e9 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b for instance with vm_state building and task_state spawning.
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d16551f0-b71a-4060-86a7-99d979255d0d tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.784s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:21 user nova-compute[72992]: INFO nova.compute.manager [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Took 44.57 seconds to build instance.
Aug 15 21:15:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-796b4b53-a15a-4f6c-a71e-eb7c6bf87aed tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "828e251d-9717-494e-aea1-3d62a5942dfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.706s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:22 user nova-compute[72992]: INFO nova.compute.manager [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Terminating instance
Aug 15 21:15:22 user nova-compute[72992]: DEBUG nova.compute.manager [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-3c20ca2d-05ec-4b4a-ac2d-cba0cbd626d9 req-6ecca6a0-954c-4bcc-858e-242609d15bea service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received event network-vif-unplugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3c20ca2d-05ec-4b4a-ac2d-cba0cbd626d9 req-6ecca6a0-954c-4bcc-858e-242609d15bea service nova] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3c20ca2d-05ec-4b4a-ac2d-cba0cbd626d9 req-6ecca6a0-954c-4bcc-858e-242609d15bea service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3c20ca2d-05ec-4b4a-ac2d-cba0cbd626d9 req-6ecca6a0-954c-4bcc-858e-242609d15bea service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-3c20ca2d-05ec-4b4a-ac2d-cba0cbd626d9 req-6ecca6a0-954c-4bcc-858e-242609d15bea service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] No waiting events found dispatching network-vif-unplugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-3c20ca2d-05ec-4b4a-ac2d-cba0cbd626d9 req-6ecca6a0-954c-4bcc-858e-242609d15bea service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received event network-vif-unplugged-fee09452-43d8-4fd2-af58-2b6312519fa0 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:15:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Instance destroyed successfully.
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lazy-loading 'resources' on Instance uuid b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-914572132',display_name='tempest-DeleteServersTestJSON-server-914572132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-914572132',id=1,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5982fc78169c4da5a1cfc5a8676ba36f',ramdisk_id='',reservation_id='r-1iom0n8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-297550545',owner_user_name='tempest-DeleteServersTestJSON-297550545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:13:36Z,user_data=None,user_id='97e344509ed941aa96fd4039579d65a8',uuid=b9ca6a8a-ebfe-47b7-8379-20b0aca36e97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Converting VIF {"id": "fee09452-43d8-4fd2-af58-2b6312519fa0", "address": "fa:16:3e:50:a1:99", "network": {"id": "4a495025-4529-4435-8b56-06631930d62d", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2040913845-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5982fc78169c4da5a1cfc5a8676ba36f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfee09452-43", "ovs_interfaceid": "fee09452-43d8-4fd2-af58-2b6312519fa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:a1:99,bridge_name='br-int',has_traffic_filtering=True,id=fee09452-43d8-4fd2-af58-2b6312519fa0,network=Network(4a495025-4529-4435-8b56-06631930d62d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee09452-43') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_vif [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a1:99,bridge_name='br-int',has_traffic_filtering=True,id=fee09452-43d8-4fd2-af58-2b6312519fa0,network=Network(4a495025-4529-4435-8b56-06631930d62d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee09452-43') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfee09452-43, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:23 user nova-compute[72992]: INFO os_vif [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:a1:99,bridge_name='br-int',has_traffic_filtering=True,id=fee09452-43d8-4fd2-af58-2b6312519fa0,network=Network(4a495025-4529-4435-8b56-06631930d62d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfee09452-43')
Aug 15 21:15:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLbKWuVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c7dcc7-6ce0-4b95-9d84-b8bf02190930]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa25a3e6-4db6-404f-b833-8de0ad5e10b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:23 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:23 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:23 user nova-compute[72992]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b (non-flash)
Aug 15 21:15:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:23 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:23 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:23 user nova-compute[72992]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b (non-flash)
Aug 15 21:15:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c883cd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b'): ({'sde'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Removing single pathed devices sde {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fa5bc8-4c11-4120-8c1d-1b2e863a21bd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[25437393-df5d-466c-bbf8-22b953c42d86]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Flushing IO for device /dev/sde {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c27e97-79d1-439e-a788-67f5fc7b19bc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59534bb-76fa-4ee9-85c8-253fcbef5d31]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[67726dc3-6e9b-4397-ac52-13df8bf0838e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2ed98b-f58a-4e23-89cd-02d05eaf54d9]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260]
Aug 15 21:15:23 user nova-compute[72992]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2a43d1-278e-4b36-8dd9-8c9a66f0291b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddb39fa-b206-4174-aaae-61eea618438c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] <== disconnect_volume: return (325ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:15:24 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Deleting instance files /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97_del
Aug 15 21:15:24 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Deletion of /opt/stack/data/nova/instances/b9ca6a8a-ebfe-47b7-8379-20b0aca36e97_del complete
Aug 15 21:15:24 user nova-compute[72992]: INFO nova.compute.manager [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 15 21:15:24 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-024f9197-94a1-40f2-a9ea-9221276cced9 req-5c3be6f4-a236-4214-a08b-81b16a5edeed service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received event network-vif-deleted-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:24 user nova-compute[72992]: INFO nova.compute.manager [req-024f9197-94a1-40f2-a9ea-9221276cced9 req-5c3be6f4-a236-4214-a08b-81b16a5edeed service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Neutron deleted interface fee09452-43d8-4fd2-af58-2b6312519fa0; detaching it from the instance and deleting it from the info cache
Aug 15 21:15:24 user nova-compute[72992]: DEBUG nova.network.neutron [req-024f9197-94a1-40f2-a9ea-9221276cced9 req-5c3be6f4-a236-4214-a08b-81b16a5edeed service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:24 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Took 0.77 seconds to deallocate network for instance.
Aug 15 21:15:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-024f9197-94a1-40f2-a9ea-9221276cced9 req-5c3be6f4-a236-4214-a08b-81b16a5edeed service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Detach interface failed, port_id=fee09452-43d8-4fd2-af58-2b6312519fa0, reason: Instance b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:15:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-7120493d-97ca-4392-a98a-039ee3564429 req-abd3dbff-5668-4839-9340-18680d53f6b5 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received event network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7120493d-97ca-4392-a98a-039ee3564429 req-abd3dbff-5668-4839-9340-18680d53f6b5 service nova] Acquiring lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7120493d-97ca-4392-a98a-039ee3564429 req-abd3dbff-5668-4839-9340-18680d53f6b5 service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7120493d-97ca-4392-a98a-039ee3564429 req-abd3dbff-5668-4839-9340-18680d53f6b5 service nova] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-7120493d-97ca-4392-a98a-039ee3564429 req-abd3dbff-5668-4839-9340-18680d53f6b5 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] No waiting events found dispatching network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:25 user nova-compute[72992]: WARNING nova.compute.manager [req-7120493d-97ca-4392-a98a-039ee3564429 req-abd3dbff-5668-4839-9340-18680d53f6b5 service nova] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Received unexpected event network-vif-plugged-fee09452-43d8-4fd2-af58-2b6312519fa0 for instance with vm_state active and task_state deleting.
Aug 15 21:15:25 user nova-compute[72992]: INFO nova.compute.manager [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Took 1.10 seconds to detach 1 volumes for instance.
Aug 15 21:15:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:26 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:15:26 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:15:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:27 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Deleted allocations for instance b9ca6a8a-ebfe-47b7-8379-20b0aca36e97
Aug 15 21:15:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-changed-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Refreshing instance network info cache due to event network-changed-3948f668-80b4-4292-bff0-2274bc789d51. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] Acquiring lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] Acquired lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG nova.network.neutron [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Refreshing network info cache for port 3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-464f5a3f-addc-48d2-b003-ad72d53d7e22 tempest-DeleteServersTestJSON-297550545 tempest-DeleteServersTestJSON-297550545-project-member] Lock "b9ca6a8a-ebfe-47b7-8379-20b0aca36e97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.452s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjSWKHxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:27 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:27 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:27 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fc73f1-4618-4df2-bc32-c93e48a62fb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:27 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa0083-f07f-41a5-ae4a-59fb5fbddde7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722] added
Aug 15 21:15:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[285fe080-a1fd-4b0c-bd12-c8322d108679]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac3718-aec2-4176-8396-b5f462b81548]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjSWKHxh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjSWKHxh" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1819e12f-17cf-4136-a662-6598e9d43b2e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjSWKHxh'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[073e172e-f0ed-4fff-99b4-ea57daad1e50]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[224951d0-5fea-493f-969f-50e6c83d9cb4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG nova.network.neutron [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Updated VIF entry in instance network info cache for port 3948f668-80b4-4292-bff0-2274bc789d51. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG nova.network.neutron [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Updating instance_info_cache with network_info: [{"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28769b4-1e0b-4c23-b432-4c51db617744]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]
Aug 15 21:15:27 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d3636e26-445d-4c70-b268-6ae05aeacfec req-96042fe4-e95f-4700-9683-6f1c6f8774e8 service nova] Releasing lock "refresh_cache-81bd731c-9957-41c5-9ecb-460870323a44" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b8161-bbdb-4307-af9e-35b0b20d906f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d393d2a-c5ee-4580-a0a0-9a56c2723b17]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:27 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c7a68-a437-4970-a1cf-0a128d7d68c7]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:28 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjSWKHxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23661316437346261', 'path': '/dev/sde'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661316437346261', 'path': '/dev/sde'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:15:29 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:29 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:15:29 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:15:29 user nova-compute[72992]:   <serial>ef79e12b-68d1-4205-845d-a38866af8722</serial>
Aug 15 21:15:29 user nova-compute[72992]: </disk>
Aug 15 21:15:29 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No VIF found with MAC fa:16:3e:d7:04:4c, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-71f8fd20-2431-45fb-8bf9-12cacdd5a7e8 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.772s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqrsYKUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:30 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:30 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:30 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba25c27-5831-428a-8fa0-8027eb96c448]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:30 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cebd6f1-7c39-4642-adc4-c51aecf88672]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7] added
Aug 15 21:15:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f4890a-1353-4f5f-888a-6005ce0ffb53]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77501ae-5ffe-4718-8973-ec9f07c4a55e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqrsYKUd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqrsYKUd" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2450e5-931c-4781-bce3-ceb94b4d1d58]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqrsYKUd'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a56a76c-8078-4c9d-9e3b-2eb7c08404a0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f396ac2f-7f63-4aa8-bbc8-dc6dfdd1af8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c003b818-d282-47e0-9693-4fd49d815be9 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c003b818-d282-47e0-9693-4fd49d815be9 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c003b818-d282-47e0-9693-4fd49d815be9 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c003b818-d282-47e0-9693-4fd49d815be9 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72992) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c003b818-d282-47e0-9693-4fd49d815be9 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5da003-b649-4692-af96-70c9fc590a2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260]
Aug 15 21:15:30 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7958414-1e35-40e6-8510-17afb476e52f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5345f0-4557-44d2-a3e2-e1ec34e12624]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17fda30-0380-446e-a0f7-b34bfe4258c6]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-d532f0da-7051-4c3e-8399-d5f445c53cf7 req-7475890f-6c4a-4f8a-9ab4-29fe5a4c60a3 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d532f0da-7051-4c3e-8399-d5f445c53cf7 req-7475890f-6c4a-4f8a-9ab4-29fe5a4c60a3 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d532f0da-7051-4c3e-8399-d5f445c53cf7 req-7475890f-6c4a-4f8a-9ab4-29fe5a4c60a3 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d532f0da-7051-4c3e-8399-d5f445c53cf7 req-7475890f-6c4a-4f8a-9ab4-29fe5a4c60a3 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-d532f0da-7051-4c3e-8399-d5f445c53cf7 req-7475890f-6c4a-4f8a-9ab4-29fe5a4c60a3 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:31 user nova-compute[72992]: WARNING nova.compute.manager [req-d532f0da-7051-4c3e-8399-d5f445c53cf7 req-7475890f-6c4a-4f8a-9ab4-29fe5a4c60a3 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state active and task_state powering-off.
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lazy-loading 'flavor' on Instance uuid 81bd731c-9957-41c5-9ecb-460870323a44 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:31 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance destroyed successfully.
Aug 15 21:15:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c003b818-d282-47e0-9693-4fd49d815be9 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c003b818-d282-47e0-9693-4fd49d815be9 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.934s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.011s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:31 user nova-compute[72992]: INFO nova.compute.manager [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Attaching volume c4250e2d-cf44-4b32-97af-3a6722fc4bd6 to /dev/sdc
Aug 15 21:15:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqrsYKUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26631633539646231', 'path': '/dev/sdf'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631633539646231', 'path': '/dev/sdf'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG nova.objects.instance [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid 412a57dc-d6a0-44ec-a661-05fed5309955 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:15:31 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:31 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:15:31 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:15:31 user nova-compute[72992]:   <serial>b22eee57-a519-4312-88c2-56ce3ce936c7</serial>
Aug 15 21:15:31 user nova-compute[72992]: </disk>
Aug 15 21:15:31 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG os_brick.utils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3fe11-e7f1-4592-bee9-efe2014019d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[44547f72-7d50-4496-8052-eb05dc1ff6c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f596348-160c-4dcb-8d28-b40eae5719ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84d076-be37-437b-81eb-79a964dc79eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:32 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:15:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33bb1f2-630f-4462-b0bf-8603446273d9]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG os_brick.utils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] <== get_connector_properties: return (250ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Updating existing volume attachment record: 27ef4f87-d673-4c1a-9b33-d7f13d502590 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No VIF found with MAC fa:16:3e:47:e0:4a, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-975bcf10-ffcd-4c19-92c7-e2c58a66c162 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.771s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-a5bbdb19-36b4-4f4d-aa92-7f9b801f1d3a req-bcc465d2-244f-4707-9eb0-3968b64184fa service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a5bbdb19-36b4-4f4d-aa92-7f9b801f1d3a req-bcc465d2-244f-4707-9eb0-3968b64184fa service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a5bbdb19-36b4-4f4d-aa92-7f9b801f1d3a req-bcc465d2-244f-4707-9eb0-3968b64184fa service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a5bbdb19-36b4-4f4d-aa92-7f9b801f1d3a req-bcc465d2-244f-4707-9eb0-3968b64184fa service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-a5bbdb19-36b4-4f4d-aa92-7f9b801f1d3a req-bcc465d2-244f-4707-9eb0-3968b64184fa service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:33 user nova-compute[72992]: WARNING nova.compute.manager [req-a5bbdb19-36b4-4f4d-aa92-7f9b801f1d3a req-bcc465d2-244f-4707-9eb0-3968b64184fa service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state stopped and task_state None.
Aug 15 21:15:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:15:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:15:35 user nova-compute[72992]: INFO nova.compute.claims [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Claim successful on node user
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:15:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.policy [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd12f60b35e7843838c7dcfb4487dee7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41e38d3f853443ea9f6352679b3240f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:15:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Creating image(s)
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "/opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk 1073741824" returned: 0 in 0.059s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Successfully created port: 2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.232s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Cannot resize image /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.objects.instance [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'migration_context' on Instance uuid 914c0df8-2c4e-4aa4-80d6-fc21886abc8a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Ensure instance console log exists: /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-changed-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Refreshing instance network info cache due to event network-changed-f24d6e3f-eaef-4a2a-8553-3465e82231ca. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] Acquiring lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] Acquired lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG nova.network.neutron [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Refreshing network info cache for port f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lazy-loading 'flavor' on Instance uuid 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Successfully updated port: 2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquired lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-changed-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Refreshing instance network info cache due to event network-changed-2a6d4e92-3b86-45f5-aabb-cecde326debc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] Acquiring lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:38 user nova-compute[72992]: INFO nova.compute.manager [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Attaching volume 10e8a452-4965-491d-8179-259c98192efe to /dev/vdb
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG os_brick.utils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ae505c-0f39-458c-ac97-25a56dd95951]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea84fd5-5a29-460e-8bdc-c214b063a90d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[69997839-56cd-4b31-a41f-b5d1ce7a2d81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f54c2-5a7d-44b7-a868-4f4a9cf9fff8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:38 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebabd97a-598d-4973-9f79-2dc9b29572c2]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG os_brick.utils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Updating existing volume attachment record: 5cdfeda5-cde1-44eb-b497-110d41825fce {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134123.6272874, b9ca6a8a-ebfe-47b7-8379-20b0aca36e97 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:38 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] VM Stopped (Lifecycle Event)
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a24e9c08-45a3-4c5b-910b-0f9059b6a550 None None] [instance: b9ca6a8a-ebfe-47b7-8379-20b0aca36e97] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.neutron [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Updated VIF entry in instance network info cache for port f24d6e3f-eaef-4a2a-8553-3465e82231ca. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.neutron [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Updating instance_info_cache with network_info: [{"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-82fa4ca8-f40b-4cfd-83a0-33f99b5fe3b6 req-2351461e-fb52-4526-a282-5b45519e3597 service nova] Releasing lock "refresh_cache-9bc3a41b-c56e-41db-9897-bd9f7554869d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Updating instance_info_cache with network_info: [{"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Releasing lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Instance network_info: |[{"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] Acquired lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.neutron [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Refreshing network info cache for port 2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Start _get_guest_xml network_info=[{"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:15:38 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:38 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-195497012',display_name='tempest-AttachVolumeNegativeTest-server-195497012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-195497012',id=12,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU08spH918kdcWBGTRIPwfCfVYeY9sBFA5UbcDzdXSWukfXsSaae7t8DjnNe5ulJzZ4/DSb7f0u7OUCHh3I9GeO4jM7bYSlNI63TD7EOq/65T5CpQnuRktrqjUX77JPVA==',key_name='tempest-keypair-1938965096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-ghak2kp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=914c0df8-2c4e-4aa4-80d6-fc21886abc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:26:85,bridge_name='br-int',has_traffic_filtering=True,id=2a6d4e92-3b86-45f5-aabb-cecde326debc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6d4e92-3b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.objects.instance [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'pci_devices' on Instance uuid 914c0df8-2c4e-4aa4-80d6-fc21886abc8a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:15:38 user nova-compute[72992]:   <uuid>914c0df8-2c4e-4aa4-80d6-fc21886abc8a</uuid>
Aug 15 21:15:38 user nova-compute[72992]:   <name>instance-0000000c</name>
Aug 15 21:15:38 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:15:38 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:15:38 user nova-compute[72992]:   <metadata>
Aug 15 21:15:38 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:15:38 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:15:38 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeNegativeTest-server-195497012</nova:name>
Aug 15 21:15:38 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:15:38</nova:creationTime>
Aug 15 21:15:38 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:15:38 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:15:38 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:15:38 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:15:38 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:15:38 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:15:38 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:15:38 user nova-compute[72992]:       <nova:owner>
Aug 15 21:15:38 user nova-compute[72992]:         <nova:user uuid="d12f60b35e7843838c7dcfb4487dee7d">tempest-AttachVolumeNegativeTest-1657501102-project-member</nova:user>
Aug 15 21:15:38 user nova-compute[72992]:         <nova:project uuid="b41e38d3f853443ea9f6352679b3240f">tempest-AttachVolumeNegativeTest-1657501102</nova:project>
Aug 15 21:15:38 user nova-compute[72992]:       </nova:owner>
Aug 15 21:15:38 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:15:38 user nova-compute[72992]:       <nova:ports>
Aug 15 21:15:38 user nova-compute[72992]:         <nova:port uuid="2a6d4e92-3b86-45f5-aabb-cecde326debc">
Aug 15 21:15:38 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:15:38 user nova-compute[72992]:         </nova:port>
Aug 15 21:15:38 user nova-compute[72992]:       </nova:ports>
Aug 15 21:15:38 user nova-compute[72992]:     </nova:instance>
Aug 15 21:15:38 user nova-compute[72992]:   </metadata>
Aug 15 21:15:38 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:15:38 user nova-compute[72992]:     <system>
Aug 15 21:15:38 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:15:38 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:15:38 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:15:38 user nova-compute[72992]:       <entry name="serial">914c0df8-2c4e-4aa4-80d6-fc21886abc8a</entry>
Aug 15 21:15:38 user nova-compute[72992]:       <entry name="uuid">914c0df8-2c4e-4aa4-80d6-fc21886abc8a</entry>
Aug 15 21:15:38 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:15:38 user nova-compute[72992]:     </system>
Aug 15 21:15:38 user nova-compute[72992]:   </sysinfo>
Aug 15 21:15:38 user nova-compute[72992]:   <os>
Aug 15 21:15:38 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:15:38 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:15:38 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:15:38 user nova-compute[72992]:   </os>
Aug 15 21:15:38 user nova-compute[72992]:   <features>
Aug 15 21:15:38 user nova-compute[72992]:     <acpi/>
Aug 15 21:15:38 user nova-compute[72992]:     <apic/>
Aug 15 21:15:38 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:15:38 user nova-compute[72992]:   </features>
Aug 15 21:15:38 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:15:38 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:15:38 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:15:38 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:15:38 user nova-compute[72992]:   </clock>
Aug 15 21:15:38 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:15:38 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:15:38 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:15:38 user nova-compute[72992]:   </cpu>
Aug 15 21:15:38 user nova-compute[72992]:   <devices>
Aug 15 21:15:38 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:15:38 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:15:38 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk"/>
Aug 15 21:15:38 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:15:38 user nova-compute[72992]:     </disk>
Aug 15 21:15:38 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:15:38 user nova-compute[72992]:       <mac address="fa:16:3e:e5:26:85"/>
Aug 15 21:15:38 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:38 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:15:38 user nova-compute[72992]:       <target dev="tap2a6d4e92-3b"/>
Aug 15 21:15:38 user nova-compute[72992]:     </interface>
Aug 15 21:15:38 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:15:38 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/console.log" append="off"/>
Aug 15 21:15:38 user nova-compute[72992]:     </serial>
Aug 15 21:15:38 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:15:38 user nova-compute[72992]:     <video>
Aug 15 21:15:38 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:15:38 user nova-compute[72992]:     </video>
Aug 15 21:15:38 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:15:38 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:15:38 user nova-compute[72992]:     </rng>
Aug 15 21:15:38 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:15:38 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:15:38 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:15:38 user nova-compute[72992]:     </memballoon>
Aug 15 21:15:38 user nova-compute[72992]:   </devices>
Aug 15 21:15:38 user nova-compute[72992]: </domain>
Aug 15 21:15:38 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-195497012',display_name='tempest-AttachVolumeNegativeTest-server-195497012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-195497012',id=12,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU08spH918kdcWBGTRIPwfCfVYeY9sBFA5UbcDzdXSWukfXsSaae7t8DjnNe5ulJzZ4/DSb7f0u7OUCHh3I9GeO4jM7bYSlNI63TD7EOq/65T5CpQnuRktrqjUX77JPVA==',key_name='tempest-keypair-1938965096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-ghak2kp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=914c0df8-2c4e-4aa4-80d6-fc21886abc8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:26:85,bridge_name='br-int',has_traffic_filtering=True,id=2a6d4e92-3b86-45f5-aabb-cecde326debc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6d4e92-3b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG os_vif [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:26:85,bridge_name='br-int',has_traffic_filtering=True,id=2a6d4e92-3b86-45f5-aabb-cecde326debc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6d4e92-3b') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a6d4e92-3b, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a6d4e92-3b, col_values=(('external_ids', {'iface-id': '2a6d4e92-3b86-45f5-aabb-cecde326debc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:26:85', 'vm-uuid': '914c0df8-2c4e-4aa4-80d6-fc21886abc8a'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:39 user nova-compute[72992]: INFO os_vif [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:26:85,bridge_name='br-int',has_traffic_filtering=True,id=2a6d4e92-3b86-45f5-aabb-cecde326debc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6d4e92-3b')
Aug 15 21:15:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No VIF found with MAC fa:16:3e:e5:26:85, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Updated VIF entry in instance network info cache for port 2a6d4e92-3b86-45f5-aabb-cecde326debc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Updating instance_info_cache with network_info: [{"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a1edf6d-e655-45d2-9373-acd4fcd0f352 req-51785b58-7aa6-4b78-92e9-9fb92610c9d3 service nova] Releasing lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-341f9292-b404-4f08-8711-7a41231dba60 req-b353dc70-5b6a-405d-b70d-df04d105514f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-341f9292-b404-4f08-8711-7a41231dba60 req-b353dc70-5b6a-405d-b70d-df04d105514f service nova] Acquiring lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-341f9292-b404-4f08-8711-7a41231dba60 req-b353dc70-5b6a-405d-b70d-df04d105514f service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-341f9292-b404-4f08-8711-7a41231dba60 req-b353dc70-5b6a-405d-b70d-df04d105514f service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-341f9292-b404-4f08-8711-7a41231dba60 req-b353dc70-5b6a-405d-b70d-df04d105514f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] No waiting events found dispatching network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:40 user nova-compute[72992]: WARNING nova.compute.manager [req-341f9292-b404-4f08-8711-7a41231dba60 req-b353dc70-5b6a-405d-b70d-df04d105514f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received unexpected event network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc for instance with vm_state building and task_state spawning.
Aug 15 21:15:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134142.6879056, 914c0df8-2c4e-4aa4-80d6-fc21886abc8a => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:42 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] VM Resumed (Lifecycle Event)
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:15:42 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Instance spawned successfully.
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:15:42 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134142.6913433, 914c0df8-2c4e-4aa4-80d6-fc21886abc8a => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:42 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] VM Started (Lifecycle Event)
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:15:42 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-2f4037e4-5b7d-407e-9e92-5ca704c160bc req-df8255ba-09f5-48d7-b80e-a4216932b0c0 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2f4037e4-5b7d-407e-9e92-5ca704c160bc req-df8255ba-09f5-48d7-b80e-a4216932b0c0 service nova] Acquiring lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2f4037e4-5b7d-407e-9e92-5ca704c160bc req-df8255ba-09f5-48d7-b80e-a4216932b0c0 service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2f4037e4-5b7d-407e-9e92-5ca704c160bc req-df8255ba-09f5-48d7-b80e-a4216932b0c0 service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-2f4037e4-5b7d-407e-9e92-5ca704c160bc req-df8255ba-09f5-48d7-b80e-a4216932b0c0 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] No waiting events found dispatching network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:42 user nova-compute[72992]: WARNING nova.compute.manager [req-2f4037e4-5b7d-407e-9e92-5ca704c160bc req-df8255ba-09f5-48d7-b80e-a4216932b0c0 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received unexpected event network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc for instance with vm_state building and task_state spawning.
Aug 15 21:15:42 user nova-compute[72992]: INFO nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 15 21:15:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:42 user nova-compute[72992]: INFO nova.compute.manager [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Took 7.17 seconds to build instance.
Aug 15 21:15:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ffd9c501-d7c0-4b3e-bc49-5a043b8530a1 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.268s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWiqXFjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:43 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:43 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:43 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da797e5-ec1f-4e1a-83f9-8e1e217ecdae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:43 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c50f7f-7d2d-4a8e-9f21-698a44c36ae7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6] added
Aug 15 21:15:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae002255-711a-48d4-9efe-81033f082033]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2f25c4-b99d-4067-adb2-13f7cf988248]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWiqXFjC {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWiqXFjC" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2bb80-3a3c-44aa-986f-d8abc63d3689]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWiqXFjC'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8bf2eb-abf9-4278-9a81-89895f81b625]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d75b33-dc02-4517-8005-bbc8f8abf5fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bbeec0-6e09-4470-beae-a2943b944249]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260]
Aug 15 21:15:43 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4969ca-1cfc-4772-81a8-dafe86ebee8c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a020ea8-eae5-4fac-81f2-e261e6c8bf61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 (non-flash)
Aug 15 21:15:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d14b64-f624-4665-b159-87720dcf2bcc]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWiqXFjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-changed-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Refreshing instance network info cache due to event network-changed-0f6e4fe9-7e44-4003-90c7-54196c955c0d. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] Acquiring lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] Acquired lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Refreshing network info cache for port 0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lazy-loading 'flavor' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23766353232303666', 'path': '/dev/sdg'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766353232303666', 'path': '/dev/sdg'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lazy-loading 'flavor' on Instance uuid 81bd731c-9957-41c5-9ecb-460870323a44 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:44 user nova-compute[72992]: INFO nova.compute.manager [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Attaching volume 853c7c72-4452-4a4b-99b1-317e6563b025 to /dev/vdb
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:15:44 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:44 user nova-compute[72992]:   <source dev="/dev/sdg"/>
Aug 15 21:15:44 user nova-compute[72992]:   <target dev="sdc" bus="scsi"/>
Aug 15 21:15:44 user nova-compute[72992]:   <serial>c4250e2d-cf44-4b32-97af-3a6722fc4bd6</serial>
Aug 15 21:15:44 user nova-compute[72992]:   <address type="drive" controller="0" unit="2"/>
Aug 15 21:15:44 user nova-compute[72992]: </disk>
Aug 15 21:15:44 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.utils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[44af8c7e-e2c1-47e2-aa2a-50cba2e8d3f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25acff1-d11b-40b2-85a1-17f62c6ba16f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d14ac-debe-4770-b3e4-c7cdd84241cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8074f8f-b584-4947-8cd0-f3b43f1fb3e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:15:44 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da926ff-67f3-4076-897f-e5d68bb42c41]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG os_brick.utils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Updating existing volume attachment record: 83b2c427-ecdf-4ed4-8c24-489bdf6e40d9 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Updated VIF entry in instance network info cache for port 0f6e4fe9-7e44-4003-90c7-54196c955c0d. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Updating instance_info_cache with network_info: [{"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8969990a-9145-4fdb-9774-f968856eb24d req-9150e76d-9b79-4f20-949f-f41c867b6a89 service nova] Releasing lock "refresh_cache-bd51cb75-790e-4c23-8c48-a3de273b900f" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:15:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] No BDM found with device name sda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] No VIF found with MAC fa:16:3e:23:db:35, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b2fef4af-e66b-4a24-b4e1-77f26b5568e7 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.473s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:46 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134131.5255651, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:15:46 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Stopped (Lifecycle Event)
Aug 15 21:15:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-99e735fc-8b82-48f4-aeda-1dfb593aac91 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:15:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-99e735fc-8b82-48f4-aeda-1dfb593aac91 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:15:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:46 user nova-compute[72992]: INFO nova.compute.manager [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Detaching volume c4250e2d-cf44-4b32-97af-3a6722fc4bd6
Aug 15 21:15:46 user nova-compute[72992]: INFO nova.virt.block_device [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Attempting to driver detach volume c4250e2d-cf44-4b32-97af-3a6722fc4bd6 from mountpoint /dev/sdc
Aug 15 21:15:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Attempting to detach device sdc from instance 81bd731c-9957-41c5-9ecb-460870323a44 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:15:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:15:46 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:46 user nova-compute[72992]:   <source dev="/dev/sdg"/>
Aug 15 21:15:46 user nova-compute[72992]:   <target dev="sdc" bus="scsi"/>
Aug 15 21:15:46 user nova-compute[72992]:   <serial>c4250e2d-cf44-4b32-97af-3a6722fc4bd6</serial>
Aug 15 21:15:46 user nova-compute[72992]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 21:15:46 user nova-compute[72992]: </disk>
Aug 15 21:15:46 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:15:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Successfully detached device sdc from instance 81bd731c-9957-41c5-9ecb-460870323a44 from the persistent domain config.
Aug 15 21:15:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 81bd731c-9957-41c5-9ecb-460870323a44 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:15:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:15:46 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:46 user nova-compute[72992]:   <source dev="/dev/sdg"/>
Aug 15 21:15:46 user nova-compute[72992]:   <target dev="sdc" bus="scsi"/>
Aug 15 21:15:46 user nova-compute[72992]:   <serial>c4250e2d-cf44-4b32-97af-3a6722fc4bd6</serial>
Aug 15 21:15:46 user nova-compute[72992]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 21:15:46 user nova-compute[72992]: </disk>
Aug 15 21:15:46 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134147.1930125, 81bd731c-9957-41c5-9ecb-460870323a44 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 81bd731c-9957-41c5-9ecb-460870323a44 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:15:47 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Successfully detached device sdc from instance 81bd731c-9957-41c5-9ecb-460870323a44 from the live domain config.
Aug 15 21:15:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWiqXFjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:47 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1438b43b-45c2-4dd1-94de-044374820819]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e1b4f9-5a5a-4297-97aa-e13ba43d3203]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 (non-flash)
Aug 15 21:15:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0cb47d2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6'): ({'sdg'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Removing single pathed devices sdg {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[acac1e71-6ac2-48ac-92f7-73c87db2840a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c35582a-0e10-450c-9f67-c931b40fb5d4]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Flushing IO for device /dev/sdg {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950e229-29a6-4820-94f0-594fb334cbb2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17bfbf3-5907-4c84-b622-d7871f30ef7d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0644d5-6850-45ea-8bda-be5d27880267]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d40b3a6-cae3-484e-8c48-e7fdf87d0d70]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260]
Aug 15 21:15:47 user nova-compute[72992]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4250e2d-cf44-4b32-97af-3a6722fc4bd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c083c84e-357f-4115-9cf9-4bf3db06914d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] <== disconnect_volume: return (308ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lazy-loading 'flavor' on Instance uuid 81bd731c-9957-41c5-9ecb-460870323a44 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3b33d874-eb27-4a9a-b2be-c7c3e0b2d940 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.749s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:48 user nova-compute[72992]: INFO nova.compute.manager [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Terminating instance
Aug 15 21:15:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-dc9873ec-c85e-4885-ac7f-d9cd117ecb7e req-114ce7fe-efb1-4ffc-804e-62a5eb6f12c9 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-vif-unplugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dc9873ec-c85e-4885-ac7f-d9cd117ecb7e req-114ce7fe-efb1-4ffc-804e-62a5eb6f12c9 service nova] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dc9873ec-c85e-4885-ac7f-d9cd117ecb7e req-114ce7fe-efb1-4ffc-804e-62a5eb6f12c9 service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dc9873ec-c85e-4885-ac7f-d9cd117ecb7e req-114ce7fe-efb1-4ffc-804e-62a5eb6f12c9 service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-dc9873ec-c85e-4885-ac7f-d9cd117ecb7e req-114ce7fe-efb1-4ffc-804e-62a5eb6f12c9 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] No waiting events found dispatching network-vif-unplugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-dc9873ec-c85e-4885-ac7f-d9cd117ecb7e req-114ce7fe-efb1-4ffc-804e-62a5eb6f12c9 service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-vif-unplugged-3948f668-80b4-4292-bff0-2274bc789d51 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:15:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Instance destroyed successfully.
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lazy-loading 'resources' on Instance uuid 81bd731c-9957-41c5-9ecb-460870323a44 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:13:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-593527229',display_name='tempest-AttachSCSIVolumeTestJSON-server-593527229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-593527229',id=8,image_ref='2b288e2c-5624-487c-bf8f-131f2f8a8536',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOZnDvpGfMn2HZa7yN5UvdBjhLx4BsqGmpBeM1q7AIt+u+cnQUyaInVMVRK5WEmhaO8DD+MI2PVA0a2q8g3iClAbCu6OVyGmfAZEyNIUvCXNB++95xiUum3Zq0unJaHvg==',key_name='tempest-keypair-2082084740',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6668413892f4783b7fa66117d6590b3',ramdisk_id='',reservation_id='r-hxkw717t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2b288e2c-5624-487c-bf8f-131f2f8a8536',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1231045332',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1231045332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c86f902acbc4c459532938dd3755593',uuid=81bd731c-9957-41c5-9ecb-460870323a44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Converting VIF {"id": "3948f668-80b4-4292-bff0-2274bc789d51", "address": "fa:16:3e:23:db:35", "network": {"id": "4fdcf84a-e8ed-4513-b472-3603d007dd1e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1158188626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6668413892f4783b7fa66117d6590b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3948f668-80", "ovs_interfaceid": "3948f668-80b4-4292-bff0-2274bc789d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:db:35,bridge_name='br-int',has_traffic_filtering=True,id=3948f668-80b4-4292-bff0-2274bc789d51,network=Network(4fdcf84a-e8ed-4513-b472-3603d007dd1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3948f668-80') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG os_vif [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:db:35,bridge_name='br-int',has_traffic_filtering=True,id=3948f668-80b4-4292-bff0-2274bc789d51,network=Network(4fdcf84a-e8ed-4513-b472-3603d007dd1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3948f668-80') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3948f668-80, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:49 user nova-compute[72992]: INFO os_vif [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:db:35,bridge_name='br-int',has_traffic_filtering=True,id=3948f668-80b4-4292-bff0-2274bc789d51,network=Network(4fdcf84a-e8ed-4513-b472-3603d007dd1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3948f668-80')
Aug 15 21:15:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Deleting instance files /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44_del
Aug 15 21:15:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Deletion of /opt/stack/data/nova/instances/81bd731c-9957-41c5-9ecb-460870323a44_del complete
Aug 15 21:15:49 user nova-compute[72992]: INFO nova.compute.manager [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 21:15:49 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:15:49 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:15:50 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:15:50 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Took 0.92 seconds to deallocate network for instance.
Aug 15 21:15:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:51 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Deleted allocations for instance 81bd731c-9957-41c5-9ecb-460870323a44
Aug 15 21:15:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46e22ec4-b3a6-44cb-8a80-71adf854f144 tempest-AttachSCSIVolumeTestJSON-1231045332 tempest-AttachSCSIVolumeTestJSON-1231045332-project-member] Lock "81bd731c-9957-41c5-9ecb-460870323a44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.513s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-751281cc-f225-4821-b414-0a32699bd1bd req-76b2625f-d2dc-4954-844f-07b89cff6f5e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-751281cc-f225-4821-b414-0a32699bd1bd req-76b2625f-d2dc-4954-844f-07b89cff6f5e service nova] Acquiring lock "81bd731c-9957-41c5-9ecb-460870323a44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-751281cc-f225-4821-b414-0a32699bd1bd req-76b2625f-d2dc-4954-844f-07b89cff6f5e service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-751281cc-f225-4821-b414-0a32699bd1bd req-76b2625f-d2dc-4954-844f-07b89cff6f5e service nova] Lock "81bd731c-9957-41c5-9ecb-460870323a44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-751281cc-f225-4821-b414-0a32699bd1bd req-76b2625f-d2dc-4954-844f-07b89cff6f5e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] No waiting events found dispatching network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:15:51 user nova-compute[72992]: WARNING nova.compute.manager [req-751281cc-f225-4821-b414-0a32699bd1bd req-76b2625f-d2dc-4954-844f-07b89cff6f5e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received unexpected event network-vif-plugged-3948f668-80b4-4292-bff0-2274bc789d51 for instance with vm_state deleted and task_state None.
Aug 15 21:15:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-751281cc-f225-4821-b414-0a32699bd1bd req-76b2625f-d2dc-4954-844f-07b89cff6f5e service nova] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Received event network-vif-deleted-3948f668-80b4-4292-bff0-2274bc789d51 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:15:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdePTCyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:15:56 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:56 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:15:56 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e60c8f-8f63-4594-8b78-25ec4aa1473b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:15:56 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0a717-dcec-4f4e-a15d-b419ce07d625]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe] added
Aug 15 21:15:56 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e98e0e1-43b3-4ba2-95c8-c6812642ebac]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb96290-ee1d-4c07-a05e-b597941f6864]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdePTCyi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdePTCyi" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd709fd-e57d-42e8-840a-07889fdfde06]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QdePTCyi'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d58333e-08a5-462b-b6d8-702ac4ed2ffd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb9cebb-5aac-43a1-bc85-dba3e1d383c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80830d0f-5c69-437c-b407-e1c349e14c87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260]
Aug 15 21:15:56 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260] successful.
Aug 15 21:15:56 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05ff0c8-472a-4ffd-bb56-10ab87aecf8a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ca4cf-2b95-46fc-b767-397b76022ef1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe (non-flash)
Aug 15 21:15:56 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:15:56 user nova-compute[72992]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe (non-flash)
Aug 15 21:15:56 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[79721de7-acfd-48cf-b596-12ccea899c8f]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:15:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdePTCyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:15:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:15:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26263353430356431', 'path': '/dev/sdg'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:15:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263353430356431', 'path': '/dev/sdg'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:15:57 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lazy-loading 'flavor' on Instance uuid 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 21:15:57 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:57 user nova-compute[72992]:   <source dev="/dev/sdg"/>
Aug 15 21:15:57 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:15:57 user nova-compute[72992]:   <serial>10e8a452-4965-491d-8179-259c98192efe</serial>
Aug 15 21:15:57 user nova-compute[72992]: </disk>
Aug 15 21:15:57 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:15:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:15:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] No VIF found with MAC fa:16:3e:e3:06:50, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:15:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e7e1b96a-89b7-47a5-b759-caea6240f8f2 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.107s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] volume_snapshot_create: create_info: {'snapshot_id': '6268e84f-280c-4319-8665-99e605b20435', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72992) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] snap xml: <domainsnapshot>
Aug 15 21:15:59 user nova-compute[72992]:   <disks>
Aug 15 21:15:59 user nova-compute[72992]:     <disk name="/dev/sdg" snapshot="external" type="file">
Aug 15 21:15:59 user nova-compute[72992]:       <source file="/dev/new_file"/>
Aug 15 21:15:59 user nova-compute[72992]:     </disk>
Aug 15 21:15:59 user nova-compute[72992]:     <disk name="vda" snapshot="no"/>
Aug 15 21:15:59 user nova-compute[72992]:   </disks>
Aug 15 21:15:59 user nova-compute[72992]: </domainsnapshot>
Aug 15 21:15:59 user nova-compute[72992]:  {{(pid=72992) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lazy-loading 'system_metadata' on Instance uuid 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:15:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     rv = execute(f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     six.reraise(c, e, tb)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     raise value
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     rv = meth(*args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     self._volume_snapshot_create(context, instance, guest,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     rv = execute(f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     six.reraise(c, e, tb)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     raise value
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     rv = meth(*args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] 
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-7295d5da-ea46-445f-b105-99e11b5156b6 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] volume_snapshot_delete: delete_info: {'volume_id': '10e8a452-4965-491d-8179-259c98192efe'} {{(pid=72992) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [None req-7295d5da-ea46-445f-b105-99e11b5156b6 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d]     if delete_info['type'] != 'qcow2':
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] KeyError: 'type'
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6268e84f-280c-4319-8665-99e605b20435 could not be found.
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6268e84f-280c-4319-8665-99e605b20435 could not be found. (HTTP 404) (Request-ID: req-26a11559-3a0f-4732-bd85-60ffd455fafc)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6268e84f-280c-4319-8665-99e605b20435 could not be found.
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server [None req-9baca836-dc6b-4c0c-ac63-5d7ce468ca11 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver [None req-7295d5da-ea46-445f-b105-99e11b5156b6 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-2985b36c-30de-4ad7-9402-f156a5b39395)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 21:15:59 user nova-compute[72992]: ERROR nova.virt.libvirt.driver 
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server [None req-7295d5da-ea46-445f-b105-99e11b5156b6 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 21:15:59 user nova-compute[72992]: ERROR oslo_messaging.rpc.server 
Aug 15 21:15:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:15:59 user nova-compute[72992]: INFO nova.compute.manager [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Detaching volume 10e8a452-4965-491d-8179-259c98192efe
Aug 15 21:15:59 user nova-compute[72992]: INFO nova.virt.block_device [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Attempting to driver detach volume 10e8a452-4965-491d-8179-259c98192efe from mountpoint /dev/vdb
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Attempting to detach device vdb from instance 9bc3a41b-c56e-41db-9897-bd9f7554869d from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 21:15:59 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:59 user nova-compute[72992]:   <source dev="/dev/sdg"/>
Aug 15 21:15:59 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:15:59 user nova-compute[72992]:   <serial>10e8a452-4965-491d-8179-259c98192efe</serial>
Aug 15 21:15:59 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:15:59 user nova-compute[72992]: </disk>
Aug 15 21:15:59 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:15:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Successfully detached device vdb from instance 9bc3a41b-c56e-41db-9897-bd9f7554869d from the persistent domain config.
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bc3a41b-c56e-41db-9897-bd9f7554869d from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:15:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 21:15:59 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:15:59 user nova-compute[72992]:   <source dev="/dev/sdg"/>
Aug 15 21:15:59 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:15:59 user nova-compute[72992]:   <serial>10e8a452-4965-491d-8179-259c98192efe</serial>
Aug 15 21:15:59 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:15:59 user nova-compute[72992]: </disk>
Aug 15 21:15:59 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134160.4263172, 9bc3a41b-c56e-41db-9897-bd9f7554869d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:16:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Successfully detached device vdb from instance 9bc3a41b-c56e-41db-9897-bd9f7554869d from the live domain config.
Aug 15 21:16:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdePTCyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:00 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5531ad-7723-4d0a-b931-32b8ef56d92e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a483d-0574-4cfc-b578-4b88ad32d729]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe (non-flash)
Aug 15 21:16:00 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:00 user nova-compute[72992]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe (non-flash)
Aug 15 21:16:00 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64f148b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe'): ({'sdg'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Removing single pathed devices sdg {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[36080531-87d2-4b2d-92c4-aae08e2c482c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d7308d-f129-43a3-aa3d-817ef149bee2]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Flushing IO for device /dev/sdg {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab72ff-1d28-412c-8ad1-030fdfa70b4b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6fd9b-378e-44c1-b146-01631e46b023]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd2f42-3fc8-403b-82f0-745f9a9a1126]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[81546d49-84a6-4212-a7c2-4497320166f8]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260]
Aug 15 21:16:00 user nova-compute[72992]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:00 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10e8a452-4965-491d-8179-259c98192efe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[85849128-e919-4b84-b0c7-16c6bf09237c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] <== disconnect_volume: return (329ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:16:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:03 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:03 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:03 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c41179d-95e7-41a2-a983-0ca16c8b7e2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:16:03 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[120fa17f-b362-485c-83a3-58da8aee6748]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025] added
Aug 15 21:16:03 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[119294e2-40e1-45ff-8466-f452f8aa9c5a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[951bac7a-5f26-4c87-9ed4-6057d8ddc385]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhsEKSzn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhsEKSzn" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b95af6-b210-4935-b313-0ee3bb460442]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PhsEKSzn'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdbeaa7-a26c-417b-a83b-b2ef40d39b09]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4999e3-f0e1-4dff-b469-3404cee39859]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lazy-loading 'flavor' on Instance uuid 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0454f54-1fe7-4e82-9270-5fc46285347f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]
Aug 15 21:16:04 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b1a23a-67a0-434e-a748-9bfe24398b23]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2bd7b381-6229-4075-ac74-26e886b26128 tempest-VolumesAssistedSnapshotsTest-1977624130 tempest-VolumesAssistedSnapshotsTest-1977624130-project-admin] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.368s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f6830a-3c2d-4702-8832-17bd104ec0d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d815ae-0402-4deb-97bd-2788a2daf421]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134149.6659338, 81bd731c-9957-41c5-9ecb-460870323a44 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:16:04 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] VM Stopped (Lifecycle Event)
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f6e875b3-ba1e-476a-9985-ba24cbbc63cf None None] [instance: 81bd731c-9957-41c5-9ecb-460870323a44] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '26138343862323239', 'path': '/dev/sdg'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138343862323239', 'path': '/dev/sdg'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lazy-loading 'flavor' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:16:05 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:16:05 user nova-compute[72992]:   <source dev="/dev/sdg"/>
Aug 15 21:16:05 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:16:05 user nova-compute[72992]:   <serial>853c7c72-4452-4a4b-99b1-317e6563b025</serial>
Aug 15 21:16:05 user nova-compute[72992]: </disk>
Aug 15 21:16:05 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] No VIF found with MAC fa:16:3e:18:c5:8d, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c15f716-024b-40ec-95d4-0ce314b6982d tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.276s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG os_brick.utils [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f663e8-1b2e-4cb9-abfe-3431e370e224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a50c70-5a1b-413b-8d91-092a31fa778c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[990c023e-4b90-4c2c-bf2c-27a5fbb66f98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e655b-c257-47e2-8a65-e6ceb325e0df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:16:07 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[85582d9c-46e2-467b-bbc0-858373cb22e3]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG os_brick.utils [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:07 user nova-compute[72992]: INFO nova.compute.manager [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Swapping volume 853c7c72-4452-4a4b-99b1-317e6563b025 for 26b727a7-3755-4f62-a6b8-c09a0a62810e
Aug 15 21:16:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:16:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:16:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7066MB free_disk=25.698360443115234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 412a57dc-d6a0-44ec-a661-05fed5309955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 9bc3a41b-c56e-41db-9897-bd9f7554869d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bd51cb75-790e-4c23-8c48-a3de273b900f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 828e251d-9717-494e-aea1-3d62a5942dfe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 914c0df8-2c4e-4aa4-80d6-fc21886abc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:16:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:16:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:16:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:16:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:16:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:16:15 user nova-compute[72992]: INFO nova.compute.claims [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Claim successful on node user
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:16:15 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:16:15 user nova-compute[72992]: INFO nova.virt.block_device [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Booting with blank volume at /dev/vda
Aug 15 21:16:15 user nova-compute[72992]: DEBUG nova.policy [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96dac56448a242a7817193b06d3ac23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d4659b5fec441f894388f4379fb182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:16:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:16 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Successfully created port: d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:16:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Successfully updated port: d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-changed-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Refreshing instance network info cache due to event network-changed-d06857b3-fd39-47f1-b65d-02d8461f4de8. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] Acquiring lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating instance_info_cache with network_info: [{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance network_info: |[{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] Acquired lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Refreshing network info cache for port d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcalnRkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd51cb75-790e-4c23-8c48-a3de273b900f', 'attached_at': '', 'detached_at': '', 'volume_id': '26b727a7-3755-4f62-a6b8-c09a0a62810e', 'serial': '26b727a7-3755-4f62-a6b8-c09a0a62810e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'bd51cb75-790e-4c23-8c48-a3de273b900f', 'attached_at': '', 'detached_at': '', 'volume_id': '853c7c72-4452-4a4b-99b1-317e6563b025', 'serial'} {{(pid=72992) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcalnRkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:17 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:17 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:17 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac38d4d-c51f-4b4b-a2f1-e33e0d9d1a20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:16:17 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[92baa50f-a59e-4ffa-b48d-a7832ffd244b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e] added
Aug 15 21:16:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updated VIF entry in instance network info cache for port d06857b3-fd39-47f1-b65d-02d8461f4de8. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating instance_info_cache with network_info: [{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8d7194a9-b23b-4e0b-8892-b9c903f0a3f5 req-d5c99b8d-f893-4d85-8d3a-5c5fde4441e0 service nova] Releasing lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6895ac2-58b1-4821-8fa6-36d1d5d831b0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[952912e7-5e56-4eab-8a60-14c4ef950007]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jcalnRkm {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jcalnRkm" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[76efa241-950e-4097-a0be-b6066fefbc84]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jcalnRkm'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c203da1-d0ad-4bec-aa43-f502a09bbcb9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cc2df0-1a49-449f-b3c1-65f0e965f070]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe1316f-15eb-4436-b03d-c5d068a058b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260]
Aug 15 21:16:18 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[31091ca1-af2d-4d31-8743-c97e23553a05]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959eeb2-f733-463a-b3c8-5e7c15d029e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[724294f1-d817-4fde-9229-88f50f8ed301]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:16:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcalnRkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:16:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:19 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26566386134613634', 'path': '/dev/sdh'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566386134613634', 'path': '/dev/sdh'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:16:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lazy-loading 'flavor' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 440401920 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG os_brick.utils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[398f5238-bf08-43ec-8313-b115265cebf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[515077da-6bb2-4a15-a87b-95a6c0d46615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d31f2-9527-4a0d-92fc-bdb01650d861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea227e46-ec75-4009-acda-8fc1c836e9e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:16:21 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:16:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c284ca3-5b62-4e83-baac-d41be2730073]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG os_brick.utils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating existing volume attachment record: cbd02412-a146-4ba2-a2ac-da7fae0b322b {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:16:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 586153984 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 716177408 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 982515712 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61ef467-33a8-40ed-8e46-399203b0449d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[343a8de6-a25e-4a1b-af37-06a60f435bfc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64e74310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'): ({'sdg'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Removing single pathed devices sdg {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b26757d-a7b8-4362-b787-81979ca57485]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9591e0-6b9c-4431-816e-aff7fdbeac83]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Flushing IO for device /dev/sdg {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:16:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c89a9ef-8d06-4a7c-b151-f90a9f6e79bd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ee7abc-a3bd-4dd9-939c-6c0a1c33cd65]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceff3fb-43e4-413e-93a1-698ffa93840b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a7505b-309e-49d1-9c34-5818a5f24e6c]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]
Aug 15 21:16:24 user nova-compute[72992]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0fefff-5834-44f7-8cc1-cc48b17cf3c5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] <== disconnect_volume: return (333ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcalnRkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'bd51cb75-790e-4c23-8c48-a3de273b900f', 'attached_at': '', 'detached_at': '', 'volume_id': '26b727a7-3755-4f62-a6b8-c09a0a62810e', 'serial'} {{(pid=72992) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] swap_volume: removing Cinder connection for volume 853c7c72-4452-4a4b-99b1-317e6563b025 {{(pid=72992) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 21:16:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] swap_volume: Updating volume 853c7c72-4452-4a4b-99b1-317e6563b025 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "jcalnRkm", "auth_password": "vfAbrzB7S0aVJP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "26b727a7-3755-4f62-a6b8-c09a0a62810e"}, "status": "reserved", "instance": "bd51cb75-790e-4c23-8c48-a3de273b900f", "attached_at": "", "detached_at": "", "volume_id": "26b727a7-3755-4f62-a6b8-c09a0a62810e", "serial": "26b727a7-3755-4f62-a6b8-c09a0a62810e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '26b727a7-3755-4f62-a6b8-c09a0a62810e', 'no_device': None, 'attachment_id': 'e62d817c-daa9-4420-b3db-86158cff410e'} {{(pid=72992) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 21:16:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027b6310-d26b-4a92-aa98-0e8a0ff50b3b tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG os_brick.utils [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[016cc7fd-ed64-462d-a7db-7dbec6354d3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5302f258-9e11-4d3b-b539-8078bf9ef493]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d8656a-a4f5-4153-b2c4-70559a25f9bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87d3bff-7123-482f-aded-79ba6f325168]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:16:26 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:16:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4837b6dc-efcc-4964-98b7-97231d7cade3]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:16:26 user nova-compute[72992]: DEBUG os_brick.utils [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:26 user nova-compute[72992]: INFO nova.compute.manager [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Swapping volume 26b727a7-3755-4f62-a6b8-c09a0a62810e for 853c7c72-4452-4a4b-99b1-317e6563b025
Aug 15 21:16:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-changed-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing instance network info cache due to event network-changed-03fb6381-c867-45c2-b4de-d9e88a8eb16c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:16:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] Acquiring lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:16:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] Acquired lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:16:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Refreshing network info cache for port 03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:16:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updated VIF entry in instance network info cache for port 03fb6381-c867-45c2-b4de-d9e88a8eb16c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:16:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eabd7915-430f-4ff2-93ed-4dd78185b999 req-3f1e3b20-cf28-4506-a795-e31669eba283 service nova] Releasing lock "refresh_cache-828e251d-9717-494e-aea1-3d62a5942dfe" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:16:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "828e251d-9717-494e-aea1-3d62a5942dfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:31 user nova-compute[72992]: INFO nova.compute.manager [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Terminating instance
Aug 15 21:16:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-7f52ebd0-7078-499d-a8ef-d82d06c4ffc3 req-52bcac35-989c-456d-94e4-4dba8b75c133 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7f52ebd0-7078-499d-a8ef-d82d06c4ffc3 req-52bcac35-989c-456d-94e4-4dba8b75c133 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7f52ebd0-7078-499d-a8ef-d82d06c4ffc3 req-52bcac35-989c-456d-94e4-4dba8b75c133 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7f52ebd0-7078-499d-a8ef-d82d06c4ffc3 req-52bcac35-989c-456d-94e4-4dba8b75c133 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-7f52ebd0-7078-499d-a8ef-d82d06c4ffc3 req-52bcac35-989c-456d-94e4-4dba8b75c133 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-unplugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-7f52ebd0-7078-499d-a8ef-d82d06c4ffc3 req-52bcac35-989c-456d-94e4-4dba8b75c133 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-d0d00dbf-d3b2-4cab-9a1b-f406bba06f9e req-f1c525b2-6b3a-41dc-8669-a62110ddb728 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d0d00dbf-d3b2-4cab-9a1b-f406bba06f9e req-f1c525b2-6b3a-41dc-8669-a62110ddb728 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d0d00dbf-d3b2-4cab-9a1b-f406bba06f9e req-f1c525b2-6b3a-41dc-8669-a62110ddb728 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d0d00dbf-d3b2-4cab-9a1b-f406bba06f9e req-f1c525b2-6b3a-41dc-8669-a62110ddb728 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-d0d00dbf-d3b2-4cab-9a1b-f406bba06f9e req-f1c525b2-6b3a-41dc-8669-a62110ddb728 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-unplugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-d0d00dbf-d3b2-4cab-9a1b-f406bba06f9e req-f1c525b2-6b3a-41dc-8669-a62110ddb728 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-4edc052c-926e-4df1-83ec-67da9a9e51db for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Instance destroyed successfully.
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lazy-loading 'resources' on Instance uuid 828e251d-9717-494e-aea1-3d62a5942dfe {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=03fb6381-c867-45c2-b4de-d9e88a8eb16c,network=Network(58730ee3-ec6d-496a-94fc-e82e0ba298d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fb6381-c8') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=03fb6381-c867-45c2-b4de-d9e88a8eb16c,network=Network(58730ee3-ec6d-496a-94fc-e82e0ba298d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fb6381-c8') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03fb6381-c8, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: INFO os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=03fb6381-c867-45c2-b4de-d9e88a8eb16c,network=Network(58730ee3-ec6d-496a-94fc-e82e0ba298d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03fb6381-c8')
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:03:c1,bridge_name='br-int',has_traffic_filtering=True,id=c53600fd-45c2-4d10-9473-6375047cbc02,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc53600fd-45') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:03:c1,bridge_name='br-int',has_traffic_filtering=True,id=c53600fd-45c2-4d10-9473-6375047cbc02,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc53600fd-45') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc53600fd-45, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: INFO os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:03:c1,bridge_name='br-int',has_traffic_filtering=True,id=c53600fd-45c2-4d10-9473-6375047cbc02,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc53600fd-45')
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:6f,bridge_name='br-int',has_traffic_filtering=True,id=3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b4e4fcd-7b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:6f,bridge_name='br-int',has_traffic_filtering=True,id=3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b4e4fcd-7b') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b4e4fcd-7b, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: INFO os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:6f,bridge_name='br-int',has_traffic_filtering=True,id=3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3b4e4fcd-7b')
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:92:3b,bridge_name='br-int',has_traffic_filtering=True,id=4edc052c-926e-4df1-83ec-67da9a9e51db,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edc052c-92') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:92:3b,bridge_name='br-int',has_traffic_filtering=True,id=4edc052c-926e-4df1-83ec-67da9a9e51db,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edc052c-92') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4edc052c-92, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: INFO os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:92:3b,bridge_name='br-int',has_traffic_filtering=True,id=4edc052c-926e-4df1-83ec-67da9a9e51db,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4edc052c-92')
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:b2:82,bridge_name='br-int',has_traffic_filtering=True,id=b4e7b210-6454-41ce-9a2b-a5947d771863,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4e7b210-64') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:b2:82,bridge_name='br-int',has_traffic_filtering=True,id=b4e7b210-6454-41ce-9a2b-a5947d771863,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4e7b210-64') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4e7b210-64, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: INFO os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:b2:82,bridge_name='br-int',has_traffic_filtering=True,id=b4e7b210-6454-41ce-9a2b-a5947d771863,network=Network(f3664505-43de-4e2a-9a3d-e98c29f398c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4e7b210-64')
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:46:77,bridge_name='br-int',has_traffic_filtering=True,id=5f51ad5d-343f-4a77-93d8-875526481090,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f51ad5d-34') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:46:77,bridge_name='br-int',has_traffic_filtering=True,id=5f51ad5d-343f-4a77-93d8-875526481090,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f51ad5d-34') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f51ad5d-34, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: INFO os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:46:77,bridge_name='br-int',has_traffic_filtering=True,id=5f51ad5d-343f-4a77-93d8-875526481090,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f51ad5d-34')
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:14:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1162800973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1162800973',id=11,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDM3fQ858DNH0ixcBX6O9+0tKdt9EJdv4v+s+xsIKc4wDQco0jjS/n6D0G6026Ridi/v18GN13ZjjDH1shtPCOcRmM+NNBe8uNrThkDZIrqZ5/jfpo6SpYV2oE1pe4adag==',key_name='tempest-keypair-2135460598',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7bfe02b6711457a990c2e6ba01fd696',ramdisk_id='',reservation_id='r-jj2hc00e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1818994412',owner_user_name='tempest-TaggedBootDevicesTest_v242-1818994412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c36d3f2446644c5ba5fd2faf9b924b08',uuid=828e251d-9717-494e-aea1-3d62a5942dfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converting VIF {"id": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "address": "fa:16:3e:55:a6:31", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b762f30-2f", "ovs_interfaceid": "4b762f30-2f54-43fb-8464-3b9c41dd316b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a6:31,bridge_name='br-int',has_traffic_filtering=True,id=4b762f30-2f54-43fb-8464-3b9c41dd316b,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b762f30-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a6:31,bridge_name='br-int',has_traffic_filtering=True,id=4b762f30-2f54-43fb-8464-3b9c41dd316b,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b762f30-2f') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b762f30-2f, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: INFO os_vif [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a6:31,bridge_name='br-int',has_traffic_filtering=True,id=4b762f30-2f54-43fb-8464-3b9c41dd316b,network=Network(f0e96526-ebb1-44bb-b4ff-62cb13d40792),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b762f30-2f')
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jrWbnTFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ba7551-2ec4-4b85-a8f9-bb794051278f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9da70f-9530-4610-9bed-6c6f09ae30f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c884df490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e8b001-3890-4e2b-b48f-88aa7904c4e1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622f702-c9a9-471c-9f2a-0cb559c435b1]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b56cef-2416-42ce-a891-bca39bd9bc55]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:16:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Creating image(s)
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Ensure instance console log exists: /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Start _get_guest_xml network_info=[{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTfIbozS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76c6d54f-938e-42a0-84d6-659e38f21bb8', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc8b823a-18b7-45fe-ae25-205baff0ac43', 'serial': 'cc8b823a-18b7-45fe-ae25-205baff0ac43'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'cbd02412-a146-4ba2-a2ac-da7fae0b322b', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2636e6a-703f-4a5f-9534-16efedead383]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:16:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTfIbozS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b4913-a4e2-4b86-b23a-6fc85b5ae8ee]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f6894f-7fc5-443c-bf21-39ff1b1b232b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260]
Aug 15 21:16:33 user nova-compute[72992]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8683c4df-8fd3-455b-9942-cdbc663ecc56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931495a-343c-480d-8650-93bdc2a95ab6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== disconnect_volume: return (398ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.118s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:33 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVgZxQGM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3b7511-6528-47ff-99b6-deba3532968c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:16:33 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-a36a8c05-f08a-4a37-8da0-c116901a773b req-6d550f98-fdb2-47c3-9ec3-742258db0fd7 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a36a8c05-f08a-4a37-8da0-c116901a773b req-6d550f98-fdb2-47c3-9ec3-742258db0fd7 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a36a8c05-f08a-4a37-8da0-c116901a773b req-6d550f98-fdb2-47c3-9ec3-742258db0fd7 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a36a8c05-f08a-4a37-8da0-c116901a773b req-6d550f98-fdb2-47c3-9ec3-742258db0fd7 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-a36a8c05-f08a-4a37-8da0-c116901a773b req-6d550f98-fdb2-47c3-9ec3-742258db0fd7 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-unplugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-a36a8c05-f08a-4a37-8da0-c116901a773b req-6d550f98-fdb2-47c3-9ec3-742258db0fd7 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-c53600fd-45c2-4d10-9473-6375047cbc02 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bbcb7c-fb78-401e-8688-497b421f7715]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43] added
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[75086c6c-f011-42fb-8ea5-b51954a795c6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[921c1da5-2857-4f70-8dcc-0c86035d75cd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTfIbozS {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTfIbozS" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[183d9d75-2a11-4c86-a739-cbbf9ad13e14]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTfIbozS'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:33 user nova-compute[72992]: WARNING nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-03fb6381-c867-45c2-b4de-d9e88a8eb16c for instance with vm_state active and task_state deleting.
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-unplugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:33 user nova-compute[72992]: WARNING nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78 for instance with vm_state active and task_state deleting.
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-unplugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-6438ac50-056d-4ff1-8ad3-8dc3c92761f5 req-798bb1b9-1a7a-47f4-bd1e-02d4af060a99 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-b4e7b210-6454-41ce-9a2b-a5947d771863 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[111a4aca-785a-4c8d-9fce-372e6645a307]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[370f5a92-8f60-41ba-9a6e-b947710ca971]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[09246a2a-c3e5-4f48-bccd-bc49963adf2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260]
Aug 15 21:16:33 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a31879-62f7-4d04-90c6-eac009dfe80c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[690eb6cb-d850-41d2-834b-b1b73d7070fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:16:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8931a56-a376-4e9d-b18b-833f96cd9b1c]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTfIbozS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b4924010-5ce2-4ec4-b52e-35b07aeaf9ec req-8ee0225b-f8a2-49cb-bea7-859a1593fb10 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b4924010-5ce2-4ec4-b52e-35b07aeaf9ec req-8ee0225b-f8a2-49cb-bea7-859a1593fb10 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b4924010-5ce2-4ec4-b52e-35b07aeaf9ec req-8ee0225b-f8a2-49cb-bea7-859a1593fb10 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b4924010-5ce2-4ec4-b52e-35b07aeaf9ec req-8ee0225b-f8a2-49cb-bea7-859a1593fb10 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b4924010-5ce2-4ec4-b52e-35b07aeaf9ec req-8ee0225b-f8a2-49cb-bea7-859a1593fb10 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:34 user nova-compute[72992]: WARNING nova.compute.manager [req-b4924010-5ce2-4ec4-b52e-35b07aeaf9ec req-8ee0225b-f8a2-49cb-bea7-859a1593fb10 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-4edc052c-926e-4df1-83ec-67da9a9e51db for instance with vm_state active and task_state deleting.
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== connect_volume: return (1555ms) {'type': 'block', 'scsi_wwn': '23537633737613939', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537633737613939', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.427s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1358b-5522-4ace-a951-21161d1d24f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-76923475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-76923475',id=13,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-oaaa8jg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:16:16Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=76c6d54f-938e-42a0-84d6-659e38f21bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'pci_devices' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be97e6d-00c9-4af2-8da4-48eabd4774be]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c885ae680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:16:35 user nova-compute[72992]:   <uuid>76c6d54f-938e-42a0-84d6-659e38f21bb8</uuid>
Aug 15 21:16:35 user nova-compute[72992]:   <name>instance-0000000d</name>
Aug 15 21:16:35 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:16:35 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:16:35 user nova-compute[72992]:   <metadata>
Aug 15 21:16:35 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:16:35 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:16:35 user nova-compute[72992]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-76923475</nova:name>
Aug 15 21:16:35 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:16:33</nova:creationTime>
Aug 15 21:16:35 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:16:35 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:16:35 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:16:35 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:16:35 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:16:35 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:16:35 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:16:35 user nova-compute[72992]:       <nova:owner>
Aug 15 21:16:35 user nova-compute[72992]:         <nova:user uuid="96dac56448a242a7817193b06d3ac23f">tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member</nova:user>
Aug 15 21:16:35 user nova-compute[72992]:         <nova:project uuid="c0d4659b5fec441f894388f4379fb182">tempest-ServerBootFromVolumeStableRescueTest-47310148</nova:project>
Aug 15 21:16:35 user nova-compute[72992]:       </nova:owner>
Aug 15 21:16:35 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:16:35 user nova-compute[72992]:       <nova:ports>
Aug 15 21:16:35 user nova-compute[72992]:         <nova:port uuid="d06857b3-fd39-47f1-b65d-02d8461f4de8">
Aug 15 21:16:35 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 21:16:35 user nova-compute[72992]:         </nova:port>
Aug 15 21:16:35 user nova-compute[72992]:       </nova:ports>
Aug 15 21:16:35 user nova-compute[72992]:     </nova:instance>
Aug 15 21:16:35 user nova-compute[72992]:   </metadata>
Aug 15 21:16:35 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:16:35 user nova-compute[72992]:     <system>
Aug 15 21:16:35 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:16:35 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:16:35 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:16:35 user nova-compute[72992]:       <entry name="serial">76c6d54f-938e-42a0-84d6-659e38f21bb8</entry>
Aug 15 21:16:35 user nova-compute[72992]:       <entry name="uuid">76c6d54f-938e-42a0-84d6-659e38f21bb8</entry>
Aug 15 21:16:35 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:16:35 user nova-compute[72992]:     </system>
Aug 15 21:16:35 user nova-compute[72992]:   </sysinfo>
Aug 15 21:16:35 user nova-compute[72992]:   <os>
Aug 15 21:16:35 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:16:35 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:16:35 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:16:35 user nova-compute[72992]:   </os>
Aug 15 21:16:35 user nova-compute[72992]:   <features>
Aug 15 21:16:35 user nova-compute[72992]:     <acpi/>
Aug 15 21:16:35 user nova-compute[72992]:     <apic/>
Aug 15 21:16:35 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:16:35 user nova-compute[72992]:   </features>
Aug 15 21:16:35 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:16:35 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:16:35 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:16:35 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:16:35 user nova-compute[72992]:   </clock>
Aug 15 21:16:35 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:16:35 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:16:35 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:16:35 user nova-compute[72992]:   </cpu>
Aug 15 21:16:35 user nova-compute[72992]:   <devices>
Aug 15 21:16:35 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:16:35 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:16:35 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:16:35 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:16:35 user nova-compute[72992]:       <serial>cc8b823a-18b7-45fe-ae25-205baff0ac43</serial>
Aug 15 21:16:35 user nova-compute[72992]:     </disk>
Aug 15 21:16:35 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:16:35 user nova-compute[72992]:       <mac address="fa:16:3e:a7:cd:25"/>
Aug 15 21:16:35 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:16:35 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:16:35 user nova-compute[72992]:       <target dev="tapd06857b3-fd"/>
Aug 15 21:16:35 user nova-compute[72992]:     </interface>
Aug 15 21:16:35 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:16:35 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/console.log" append="off"/>
Aug 15 21:16:35 user nova-compute[72992]:     </serial>
Aug 15 21:16:35 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:16:35 user nova-compute[72992]:     <video>
Aug 15 21:16:35 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:16:35 user nova-compute[72992]:     </video>
Aug 15 21:16:35 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:16:35 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:16:35 user nova-compute[72992]:     </rng>
Aug 15 21:16:35 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:16:35 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:16:35 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:16:35 user nova-compute[72992]:     </memballoon>
Aug 15 21:16:35 user nova-compute[72992]:   </devices>
Aug 15 21:16:35 user nova-compute[72992]: </domain>
Aug 15 21:16:35 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-76923475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-76923475',id=13,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-oaaa8jg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:16:16Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=76c6d54f-938e-42a0-84d6-659e38f21bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_vif [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd06857b3-fd, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd06857b3-fd, col_values=(('external_ids', {'iface-id': 'd06857b3-fd39-47f1-b65d-02d8461f4de8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:cd:25', 'vm-uuid': '76c6d54f-938e-42a0-84d6-659e38f21bb8'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1837f1a1-fd54-426a-ab0c-678811ba6f85]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:35 user nova-compute[72992]: INFO os_vif [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd')
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf615bc4-3c67-4969-8087-1d0285f84a24]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[70801263-172f-448f-8935-e3b91094d0cf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86e4fec-e4bf-4d21-b5fa-0a446932d7b1]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No VIF found with MAC fa:16:3e:a7:cd:25, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be293c8-15b4-4e69-a4a1-c63196b57106]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2ad321-4685-4cb2-b2b4-015af944bf98]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260]
Aug 15 21:16:35 user nova-compute[72992]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0526857-d388-435a-afa4-eb74a7010025 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a50fe0-6e9f-491a-a97f-24f265d00999]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== disconnect_volume: return (1754ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cknRxTyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd1574-fd4e-4617-b0c9-ef6ce813cb45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e432ad2-6364-4df0-a7fa-010fc32ddd41]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c885ae680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ff999-3109-4df9-90ae-e59ff45c2a16]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1719fcdb-73e4-4f60-a221-0a7c8d5722ef]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[81223f2f-2633-4020-92af-d6835485df96]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff6f62-5118-4553-b180-da4c91847d8d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc6359f-14ed-4748-a271-ddb02c9cef6f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[156dc27b-8927-4903-a708-dce9df4078ca]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260]
Aug 15 21:16:35 user nova-compute[72992]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51e87d8-edad-467c-9322-24660ad8eb8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3709661-00a9-4285-b7e7-52e362613ed0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] <== disconnect_volume: return (323ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:16:35 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Deleting instance files /opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe_del
Aug 15 21:16:35 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Deletion of /opt/stack/data/nova/instances/828e251d-9717-494e-aea1-3d62a5942dfe_del complete
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:35 user nova-compute[72992]: WARNING nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-c53600fd-45c2-4d10-9473-6375047cbc02 for instance with vm_state active and task_state deleting.
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-unplugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-4b762f30-2f54-43fb-8464-3b9c41dd316b for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:35 user nova-compute[72992]: WARNING nova.compute.manager [req-d319e837-024e-4d5c-af49-12e556e511fa req-0f13abba-e2f3-45e1-814b-233c531b2ca6 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-4b762f30-2f54-43fb-8464-3b9c41dd316b for instance with vm_state active and task_state deleting.
Aug 15 21:16:35 user nova-compute[72992]: INFO nova.compute.manager [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Took 4.70 seconds to destroy the instance on the hypervisor.
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:35 user nova-compute[72992]: WARNING nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-b4e7b210-6454-41ce-9a2b-a5947d771863 for instance with vm_state active and task_state deleting.
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-unplugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-unplugged-5f51ad5d-343f-4a77-93d8-875526481090 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Acquiring lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] Lock "828e251d-9717-494e-aea1-3d62a5942dfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] No waiting events found dispatching network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:35 user nova-compute[72992]: WARNING nova.compute.manager [req-9329ce28-32ae-444d-a420-0d2d7798c27d req-3a9860f3-09be-4448-a8ae-66a8384b21d8 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received unexpected event network-vif-plugged-5f51ad5d-343f-4a77-93d8-875526481090 for instance with vm_state active and task_state deleting.
Aug 15 21:16:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd51cb75-790e-4c23-8c48-a3de273b900f', 'attached_at': '', 'detached_at': '', 'volume_id': '853c7c72-4452-4a4b-99b1-317e6563b025', 'serial': '853c7c72-4452-4a4b-99b1-317e6563b025'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcalnRkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '26b727a7-3755-4f62-a6b8-c09a0a62810e'}, 'status': 'reserved', 'instance': 'bd51cb75-790e-4c23-8c48-a3de273b900f', 'attached_at': '', 'detached_at': '', 'volume_id': '26b727a7-3755-4f62-a6b8-c09a0a62810e', 'serial'} {{(pid=72992) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:37 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:37 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:37 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eaa9a1-e954-48a6-b148-e08cbb10ae6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:16:37 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7fe1ac-667e-44a9-9869-6fac2cbd4867]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025] added
Aug 15 21:16:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3e003c-693d-45d9-8d1a-56e8455768f8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c45920-bfcf-4dd7-a131-dcbc6e78a81e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhsEKSzn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PhsEKSzn" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62b53a8-a3e0-4ea0-8d21-a4fe2e4da7b2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PhsEKSzn'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[54db14c1-4a76-4ddb-9a63-4925037ae6ee]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cda28d-7e99-44d5-a77c-de80c43416f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b839a1a8-facf-4453-8315-986b0e688c13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]
Aug 15 21:16:37 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:37 user nova-compute[72992]: WARNING nova.compute.manager [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state building and task_state spawning.
Aug 15 21:16:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:37 user nova-compute[72992]: WARNING nova.compute.manager [req-8a00ff3d-4df5-4d92-ac71-8a664301ccc6 req-7e21b4ba-2b76-4cbc-b5e8-58035f6c69fe service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state building and task_state spawning.
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d956ed-0dfe-4a28-9cff-eab51ca01227]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed81ca58-519c-41bd-a2fb-c16b604eb327]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc080eec-7e23-424b-8d9a-85b12db5f823]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:16:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134198.9501693, 76c6d54f-938e-42a0-84d6-659e38f21bb8 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:16:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] VM Resumed (Lifecycle Event)
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26138343862323239', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138343862323239', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:16:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance spawned successfully.
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lazy-loading 'flavor' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:16:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:16:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:16:39 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:16:39 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134198.9546893, 76c6d54f-938e-42a0-84d6-659e38f21bb8 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:16:39 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] VM Started (Lifecycle Event)
Aug 15 21:16:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:16:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:16:39 user nova-compute[72992]: INFO nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Took 5.75 seconds to spawn the instance on the hypervisor.
Aug 15 21:16:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:16:39 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:16:39 user nova-compute[72992]: INFO nova.compute.manager [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Took 24.05 seconds to build instance.
Aug 15 21:16:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1ea98a6e-6378-40c9-a265-0032b0f6a4ea tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.146s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 13631488 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-deleted-4b762f30-2f54-43fb-8464-3b9c41dd316b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:40 user nova-compute[72992]: INFO nova.compute.manager [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Neutron deleted interface 4b762f30-2f54-43fb-8464-3b9c41dd316b; detaching it from the instance and deleting it from the info cache
Aug 15 21:16:40 user nova-compute[72992]: DEBUG nova.network.neutron [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f51ad5d-343f-4a77-93d8-875526481090", "address": "fa:16:3e:f5:46:77", "network": {"id": "f0e96526-ebb1-44bb-b4ff-62cb13d40792", "bridge": "br-int", "label": "tempest-device-tagging-net2-1603239541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f51ad5d-34", "ovs_interfaceid": "5f51ad5d-343f-4a77-93d8-875526481090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Detach interface failed, port_id=4b762f30-2f54-43fb-8464-3b9c41dd316b, reason: Instance 828e251d-9717-494e-aea1-3d62a5942dfe could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:16:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-deleted-5f51ad5d-343f-4a77-93d8-875526481090 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:40 user nova-compute[72992]: INFO nova.compute.manager [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Neutron deleted interface 5f51ad5d-343f-4a77-93d8-875526481090; detaching it from the instance and deleting it from the info cache
Aug 15 21:16:40 user nova-compute[72992]: DEBUG nova.network.neutron [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "address": "fa:16:3e:cd:7d:8e", "network": {"id": "58730ee3-ec6d-496a-94fc-e82e0ba298d2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794011646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03fb6381-c8", "ovs_interfaceid": "03fb6381-c867-45c2-b4de-d9e88a8eb16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-ce311f0c-543a-46ee-9144-a5dc15654413 req-a5a41f6f-801b-475d-82f7-3e833cef5efd service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Detach interface failed, port_id=5f51ad5d-343f-4a77-93d8-875526481090, reason: Instance 828e251d-9717-494e-aea1-3d62a5942dfe could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:16:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 246415360 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 437256192 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 617611264 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 744488960 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-deleted-03fb6381-c867-45c2-b4de-d9e88a8eb16c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:42 user nova-compute[72992]: INFO nova.compute.manager [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Neutron deleted interface 03fb6381-c867-45c2-b4de-d9e88a8eb16c; detaching it from the instance and deleting it from the info cache
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.network.neutron [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4edc052c-926e-4df1-83ec-67da9a9e51db", "address": "fa:16:3e:5c:92:3b", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4edc052c-92", "ovs_interfaceid": "4edc052c-926e-4df1-83ec-67da9a9e51db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Detach interface failed, port_id=03fb6381-c867-45c2-b4de-d9e88a8eb16c, reason: Instance 828e251d-9717-494e-aea1-3d62a5942dfe could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-deleted-4edc052c-926e-4df1-83ec-67da9a9e51db {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:42 user nova-compute[72992]: INFO nova.compute.manager [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Neutron deleted interface 4edc052c-926e-4df1-83ec-67da9a9e51db; detaching it from the instance and deleting it from the info cache
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.network.neutron [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [{"id": "c53600fd-45c2-4d10-9473-6375047cbc02", "address": "fa:16:3e:ce:03:c1", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53600fd-45", "ovs_interfaceid": "c53600fd-45c2-4d10-9473-6375047cbc02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "address": "fa:16:3e:5e:58:6f", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4e4fcd-7b", "ovs_interfaceid": "3b4e4fcd-7bb5-4a3e-8e1b-b2d1944b8a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b4e7b210-6454-41ce-9a2b-a5947d771863", "address": "fa:16:3e:dc:b2:82", "network": {"id": "f3664505-43de-4e2a-9a3d-e98c29f398c1", "bridge": "br-int", "label": "tempest-device-tagging-net1-786533486", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7bfe02b6711457a990c2e6ba01fd696", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4e7b210-64", "ovs_interfaceid": "b4e7b210-6454-41ce-9a2b-a5947d771863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-7055f216-d44a-4b76-af2a-997cae314ead req-052b1914-f06d-4c48-876c-fb164d806cc5 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Detach interface failed, port_id=4edc052c-926e-4df1-83ec-67da9a9e51db, reason: Instance 828e251d-9717-494e-aea1-3d62a5942dfe could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 875560960 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:42 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:42 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Took 7.19 seconds to deallocate network for instance.
Aug 15 21:16:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 1021313024 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jcalnRkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '26b727a7-3755-4f62-a6b8-c09a0a62810e'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:43 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb11934-1378-45e1-ac53-2fad082adc03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d253d4c-609f-4119-a32c-1adc4bed2c6b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c884df010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e'): ({'sdh'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Removing single pathed devices sdh {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78e4a32-c49c-42cd-b98b-03db53e45fa4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[20157fa1-2c74-4f55-b499-c7f3d4829615]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Flushing IO for device /dev/sdh {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c93e936-a34a-41d9-87cc-6be43ad48139]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb4f838-bba1-40d9-9599-9d3f0a67161f]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] SCSI volumes sdh have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:16:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.163s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f72fb5-1914-42c8-a512-51d036e29628]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[789eec6e-6897-4083-bc57-d4aa4a9af3b2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260]
Aug 15 21:16:44 user nova-compute[72992]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:44 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b727a7-3755-4f62-a6b8-c09a0a62810e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[32744eaf-b787-450c-8650-e7abb6ffbbaf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.518s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] <== disconnect_volume: return (519ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-cf60c0f5-3697-4a29-9877-eb8aed8ed8fa req-f665ba3a-a591-4318-a24a-128bba077a17 service nova] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Received event network-vif-deleted-b4e7b210-6454-41ce-9a2b-a5947d771863 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'bd51cb75-790e-4c23-8c48-a3de273b900f', 'attached_at': '', 'detached_at': '', 'volume_id': '853c7c72-4452-4a4b-99b1-317e6563b025', 'serial'} {{(pid=72992) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 21:16:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] swap_volume: removing Cinder connection for volume 26b727a7-3755-4f62-a6b8-c09a0a62810e {{(pid=72992) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 21:16:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:45 user nova-compute[72992]: INFO nova.compute.manager [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Took 2.65 seconds to detach 3 volumes for instance.
Aug 15 21:16:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] swap_volume: Updating volume 26b727a7-3755-4f62-a6b8-c09a0a62810e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "PhsEKSzn", "auth_password": "O1Y9LitPXWneEH", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "853c7c72-4452-4a4b-99b1-317e6563b025"}, "status": "reserved", "instance": "bd51cb75-790e-4c23-8c48-a3de273b900f", "attached_at": "", "detached_at": "", "volume_id": "853c7c72-4452-4a4b-99b1-317e6563b025", "serial": "853c7c72-4452-4a4b-99b1-317e6563b025"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '853c7c72-4452-4a4b-99b1-317e6563b025', 'no_device': None, 'attachment_id': '4795d0ea-1997-400d-9464-db149494a6f3'} {{(pid=72992) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 21:16:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c928250-9439-4a15-afb9-c0a2dbd8e128 tempest-TestVolumeSwap-65074961 tempest-TestVolumeSwap-65074961-project-admin] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.555s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:46 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Deleted allocations for instance 828e251d-9717-494e-aea1-3d62a5942dfe
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6e6eddc4-4178-42b2-b253-dd9c07b8a66f tempest-TaggedBootDevicesTest_v242-1818994412 tempest-TaggedBootDevicesTest_v242-1818994412-project-member] Lock "828e251d-9717-494e-aea1-3d62a5942dfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.134s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:46 user nova-compute[72992]: INFO nova.compute.manager [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Detaching volume 853c7c72-4452-4a4b-99b1-317e6563b025
Aug 15 21:16:46 user nova-compute[72992]: INFO nova.virt.block_device [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Attempting to driver detach volume 853c7c72-4452-4a4b-99b1-317e6563b025 from mountpoint /dev/vdb
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Attempting to detach device vdb from instance bd51cb75-790e-4c23-8c48-a3de273b900f from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:16:46 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:16:46 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:16:46 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:16:46 user nova-compute[72992]:   <serial>853c7c72-4452-4a4b-99b1-317e6563b025</serial>
Aug 15 21:16:46 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:16:46 user nova-compute[72992]: </disk>
Aug 15 21:16:46 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:16:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Successfully detached device vdb from instance bd51cb75-790e-4c23-8c48-a3de273b900f from the persistent domain config.
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd51cb75-790e-4c23-8c48-a3de273b900f from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:16:46 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:16:46 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:16:46 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:16:46 user nova-compute[72992]:   <serial>853c7c72-4452-4a4b-99b1-317e6563b025</serial>
Aug 15 21:16:46 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:16:46 user nova-compute[72992]: </disk>
Aug 15 21:16:46 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134206.8315465, bd51cb75-790e-4c23-8c48-a3de273b900f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:16:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Successfully detached device vdb from instance bd51cb75-790e-4c23-8c48-a3de273b900f from the live domain config.
Aug 15 21:16:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PhsEKSzn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '853c7c72-4452-4a4b-99b1-317e6563b025'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:16:46 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bb90f5-fc7c-49ff-8edd-1fae3b03dcf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179adda-ffad-4b50-96fc-af4dce567ac6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:16:46 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64f485e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[79620c41-96bf-4d28-8372-295562b1278d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e651ecdf-d7e6-4c41-a122-bb93dd6b8d8c]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca4010-5106-470e-8b29-e59f7015d24b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[319213d9-fea6-4c1f-9bc3-55e14ab682aa]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159931c-0f67-4718-8d49-af48e84c51e0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5683c466-9737-4445-8406-4ba7301aa0bd]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260]
Aug 15 21:16:47 user nova-compute[72992]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025, portal: 172.16.0.220,3260] successful.
Aug 15 21:16:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:853c7c72-4452-4a4b-99b1-317e6563b025 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[78624ed6-8653-4856-963a-dc46abab4f24]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] <== disconnect_volume: return (269ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:16:47 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134192.7631204, 828e251d-9717-494e-aea1-3d62a5942dfe => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:16:47 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] VM Stopped (Lifecycle Event)
Aug 15 21:16:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4a29d5dd-3e5f-455e-91db-a5f9d7457336 None None] [instance: 828e251d-9717-494e-aea1-3d62a5942dfe] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:16:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:16:52 user nova-compute[72992]: INFO nova.compute.claims [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Claim successful on node user
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:16:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:16:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:16:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Creating image(s)
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG nova.policy [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e935193250644d0be567384b67f9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693312b581614a3cad720c85a9bf1e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lazy-loading 'flavor' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk 1073741824" returned: 0 in 0.065s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6c8e938d-b83a-4b82-83d6-d3a8a5fa19fc tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.999s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Cannot resize image /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'migration_context' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Ensure instance console log exists: /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Successfully created port: c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Successfully updated port: c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquired lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-changed-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Refreshing instance network info cache due to event network-changed-c7f27105-873a-43db-b06f-51242eeaf115. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] Acquiring lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Releasing lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Instance network_info: |[{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] Acquired lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.neutron [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Refreshing network info cache for port c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Start _get_guest_xml network_info=[{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:16:55 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:16:55 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converting VIF {"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:74:ea,bridge_name='br-int',has_traffic_filtering=True,id=c7f27105-873a-43db-b06f-51242eeaf115,network=Network(d9538c63-8c61-49b4-b856-284c099870d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f27105-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'pci_devices' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:16:55 user nova-compute[72992]:   <uuid>ac18f6fd-751f-4a70-88b8-678eca326268</uuid>
Aug 15 21:16:55 user nova-compute[72992]:   <name>instance-0000000e</name>
Aug 15 21:16:55 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:16:55 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:16:55 user nova-compute[72992]:   <metadata>
Aug 15 21:16:55 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:16:55 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:16:55 user nova-compute[72992]:       <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:16:55 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:16:55</nova:creationTime>
Aug 15 21:16:55 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:16:55 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:16:55 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:16:55 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:16:55 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:16:55 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:16:55 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:16:55 user nova-compute[72992]:       <nova:owner>
Aug 15 21:16:55 user nova-compute[72992]:         <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:16:55 user nova-compute[72992]:         <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:16:55 user nova-compute[72992]:       </nova:owner>
Aug 15 21:16:55 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:16:55 user nova-compute[72992]:       <nova:ports>
Aug 15 21:16:55 user nova-compute[72992]:         <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:16:55 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:16:55 user nova-compute[72992]:         </nova:port>
Aug 15 21:16:55 user nova-compute[72992]:       </nova:ports>
Aug 15 21:16:55 user nova-compute[72992]:     </nova:instance>
Aug 15 21:16:55 user nova-compute[72992]:   </metadata>
Aug 15 21:16:55 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:16:55 user nova-compute[72992]:     <system>
Aug 15 21:16:55 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:16:55 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:16:55 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:16:55 user nova-compute[72992]:       <entry name="serial">ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:16:55 user nova-compute[72992]:       <entry name="uuid">ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:16:55 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:16:55 user nova-compute[72992]:     </system>
Aug 15 21:16:55 user nova-compute[72992]:   </sysinfo>
Aug 15 21:16:55 user nova-compute[72992]:   <os>
Aug 15 21:16:55 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:16:55 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:16:55 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:16:55 user nova-compute[72992]:   </os>
Aug 15 21:16:55 user nova-compute[72992]:   <features>
Aug 15 21:16:55 user nova-compute[72992]:     <acpi/>
Aug 15 21:16:55 user nova-compute[72992]:     <apic/>
Aug 15 21:16:55 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:16:55 user nova-compute[72992]:   </features>
Aug 15 21:16:55 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:16:55 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:16:55 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:16:55 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:16:55 user nova-compute[72992]:   </clock>
Aug 15 21:16:55 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:16:55 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:16:55 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:16:55 user nova-compute[72992]:   </cpu>
Aug 15 21:16:55 user nova-compute[72992]:   <devices>
Aug 15 21:16:55 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:16:55 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:16:55 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk"/>
Aug 15 21:16:55 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:16:55 user nova-compute[72992]:     </disk>
Aug 15 21:16:55 user nova-compute[72992]:     <disk type="file" device="cdrom">
Aug 15 21:16:55 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 21:16:55 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config"/>
Aug 15 21:16:55 user nova-compute[72992]:       <target dev="hda" bus="ide"/>
Aug 15 21:16:55 user nova-compute[72992]:     </disk>
Aug 15 21:16:55 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:16:55 user nova-compute[72992]:       <mac address="fa:16:3e:09:74:ea"/>
Aug 15 21:16:55 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:16:55 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:16:55 user nova-compute[72992]:       <target dev="tapc7f27105-87"/>
Aug 15 21:16:55 user nova-compute[72992]:     </interface>
Aug 15 21:16:55 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:16:55 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log" append="off"/>
Aug 15 21:16:55 user nova-compute[72992]:     </serial>
Aug 15 21:16:55 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:16:55 user nova-compute[72992]:     <video>
Aug 15 21:16:55 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:16:55 user nova-compute[72992]:     </video>
Aug 15 21:16:55 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:16:55 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:16:55 user nova-compute[72992]:     </rng>
Aug 15 21:16:55 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:16:55 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:16:55 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:16:55 user nova-compute[72992]:     </memballoon>
Aug 15 21:16:55 user nova-compute[72992]:   </devices>
Aug 15 21:16:55 user nova-compute[72992]: </domain>
Aug 15 21:16:55 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converting VIF {"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:74:ea,bridge_name='br-int',has_traffic_filtering=True,id=c7f27105-873a-43db-b06f-51242eeaf115,network=Network(d9538c63-8c61-49b4-b856-284c099870d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f27105-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG os_vif [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:74:ea,bridge_name='br-int',has_traffic_filtering=True,id=c7f27105-873a-43db-b06f-51242eeaf115,network=Network(d9538c63-8c61-49b4-b856-284c099870d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f27105-87') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7f27105-87, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7f27105-87, col_values=(('external_ids', {'iface-id': 'c7f27105-873a-43db-b06f-51242eeaf115', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:74:ea', 'vm-uuid': 'ac18f6fd-751f-4a70-88b8-678eca326268'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:55 user nova-compute[72992]: INFO os_vif [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:74:ea,bridge_name='br-int',has_traffic_filtering=True,id=c7f27105-873a-43db-b06f-51242eeaf115,network=Network(d9538c63-8c61-49b4-b856-284c099870d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f27105-87')
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No BDM found with device name hda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:16:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No VIF found with MAC fa:16:3e:09:74:ea, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:16:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Using config drive
Aug 15 21:16:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Creating config drive at /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config
Aug 15 21:16:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxsmaxvdo {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxsmaxvdo" returned: 0 in 0.068s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updated VIF entry in instance network info cache for port c7f27105-873a-43db-b06f-51242eeaf115. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ff15b18f-0c4b-4e13-8b11-f65cf955e199 req-3f8d88f0-0ddc-4f4e-a59a-e7942bc67792 service nova] Releasing lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:56 user nova-compute[72992]: INFO nova.compute.manager [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Terminating instance
Aug 15 21:16:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-a4959d34-b528-4c3e-8ac7-8e68e46abd82 req-6689abd4-9991-4cf4-a293-dcdcb9c6706c service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-vif-unplugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a4959d34-b528-4c3e-8ac7-8e68e46abd82 req-6689abd4-9991-4cf4-a293-dcdcb9c6706c service nova] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a4959d34-b528-4c3e-8ac7-8e68e46abd82 req-6689abd4-9991-4cf4-a293-dcdcb9c6706c service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a4959d34-b528-4c3e-8ac7-8e68e46abd82 req-6689abd4-9991-4cf4-a293-dcdcb9c6706c service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-a4959d34-b528-4c3e-8ac7-8e68e46abd82 req-6689abd4-9991-4cf4-a293-dcdcb9c6706c service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] No waiting events found dispatching network-vif-unplugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-a4959d34-b528-4c3e-8ac7-8e68e46abd82 req-6689abd4-9991-4cf4-a293-dcdcb9c6706c service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-vif-unplugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-3327a64c-7e37-4820-93e2-094325ddbb13 req-45f276eb-6955-4b5a-99ad-1d687c24b0a4 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3327a64c-7e37-4820-93e2-094325ddbb13 req-45f276eb-6955-4b5a-99ad-1d687c24b0a4 service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3327a64c-7e37-4820-93e2-094325ddbb13 req-45f276eb-6955-4b5a-99ad-1d687c24b0a4 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3327a64c-7e37-4820-93e2-094325ddbb13 req-45f276eb-6955-4b5a-99ad-1d687c24b0a4 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-3327a64c-7e37-4820-93e2-094325ddbb13 req-45f276eb-6955-4b5a-99ad-1d687c24b0a4 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:57 user nova-compute[72992]: WARNING nova.compute.manager [req-3327a64c-7e37-4820-93e2-094325ddbb13 req-45f276eb-6955-4b5a-99ad-1d687c24b0a4 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with vm_state building and task_state spawning.
Aug 15 21:16:58 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Instance destroyed successfully.
Aug 15 21:16:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lazy-loading 'resources' on Instance uuid 9bc3a41b-c56e-41db-9897-bd9f7554869d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-309726332',display_name='tempest-VolumesAssistedSnapshotsTest-server-309726332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-309726332',id=9,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvfZhDAG14wMCHAC1J3CTPThu/z8DfGsuseYimuvPlLxTgZ3ucf7yIUuVRcDbfjNq2J2Sc0WJcWYkA1jj7IE9IAsYWEzQs1LwZG5hidg8o7YBF8j+nQwIGCfk1xzTwNzg==',key_name='tempest-keypair-128464557',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b39052f1714498a90b3be2b3ba63a4',ramdisk_id='',reservation_id='r-3utr2c6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-775922290',owner_user_name='tempest-VolumesAssistedSnapshotsTest-775922290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0701e4d18de7432d9088b1018a9d6b97',uuid=9bc3a41b-c56e-41db-9897-bd9f7554869d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Converting VIF {"id": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "address": "fa:16:3e:e3:06:50", "network": {"id": "248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-436502772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b39052f1714498a90b3be2b3ba63a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf24d6e3f-ea", "ovs_interfaceid": "f24d6e3f-eaef-4a2a-8553-3465e82231ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:06:50,bridge_name='br-int',has_traffic_filtering=True,id=f24d6e3f-eaef-4a2a-8553-3465e82231ca,network=Network(248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf24d6e3f-ea') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG os_vif [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:06:50,bridge_name='br-int',has_traffic_filtering=True,id=f24d6e3f-eaef-4a2a-8553-3465e82231ca,network=Network(248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf24d6e3f-ea') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf24d6e3f-ea, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:58 user nova-compute[72992]: INFO os_vif [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:06:50,bridge_name='br-int',has_traffic_filtering=True,id=f24d6e3f-eaef-4a2a-8553-3465e82231ca,network=Network(248adb0a-f05e-4e60-a9f5-8fb3e9bc5cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf24d6e3f-ea')
Aug 15 21:16:58 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Deleting instance files /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d_del
Aug 15 21:16:58 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Deletion of /opt/stack/data/nova/instances/9bc3a41b-c56e-41db-9897-bd9f7554869d_del complete
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:16:58 user nova-compute[72992]: INFO nova.compute.manager [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Took 1.52 seconds to destroy the instance on the hypervisor.
Aug 15 21:16:58 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:16:58 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-76e70c67-c485-4573-ad8f-0a1834dc1918 req-5eecf288-5db5-420a-a443-fce7b3810484 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-76e70c67-c485-4573-ad8f-0a1834dc1918 req-5eecf288-5db5-420a-a443-fce7b3810484 service nova] Acquiring lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-76e70c67-c485-4573-ad8f-0a1834dc1918 req-5eecf288-5db5-420a-a443-fce7b3810484 service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-76e70c67-c485-4573-ad8f-0a1834dc1918 req-5eecf288-5db5-420a-a443-fce7b3810484 service nova] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-76e70c67-c485-4573-ad8f-0a1834dc1918 req-5eecf288-5db5-420a-a443-fce7b3810484 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] No waiting events found dispatching network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:59 user nova-compute[72992]: WARNING nova.compute.manager [req-76e70c67-c485-4573-ad8f-0a1834dc1918 req-5eecf288-5db5-420a-a443-fce7b3810484 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received unexpected event network-vif-plugged-f24d6e3f-eaef-4a2a-8553-3465e82231ca for instance with vm_state active and task_state deleting.
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:16:59 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Took 1.07 seconds to deallocate network for instance.
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-d6e21609-e965-4202-bc57-b735e8df8989 req-771b2a23-041d-400a-a726-2270c0e3dd53 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d6e21609-e965-4202-bc57-b735e8df8989 req-771b2a23-041d-400a-a726-2270c0e3dd53 service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d6e21609-e965-4202-bc57-b735e8df8989 req-771b2a23-041d-400a-a726-2270c0e3dd53 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d6e21609-e965-4202-bc57-b735e8df8989 req-771b2a23-041d-400a-a726-2270c0e3dd53 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-d6e21609-e965-4202-bc57-b735e8df8989 req-771b2a23-041d-400a-a726-2270c0e3dd53 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:16:59 user nova-compute[72992]: WARNING nova.compute.manager [req-d6e21609-e965-4202-bc57-b735e8df8989 req-771b2a23-041d-400a-a726-2270c0e3dd53 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with vm_state building and task_state spawning.
Aug 15 21:16:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-d6e21609-e965-4202-bc57-b735e8df8989 req-771b2a23-041d-400a-a726-2270c0e3dd53 service nova] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Received event network-vif-deleted-f24d6e3f-eaef-4a2a-8553-3465e82231ca {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:16:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:16:59 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Deleted allocations for instance 9bc3a41b-c56e-41db-9897-bd9f7554869d
Aug 15 21:17:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ae53485-81ff-4c51-8fb2-46377d110ac7 tempest-VolumesAssistedSnapshotsTest-775922290 tempest-VolumesAssistedSnapshotsTest-775922290-project-member] Lock "9bc3a41b-c56e-41db-9897-bd9f7554869d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.360s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134220.27967, ac18f6fd-751f-4a70-88b8-678eca326268 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] VM Resumed (Lifecycle Event)
Aug 15 21:17:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Instance spawned successfully.
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:17:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134220.2799299, ac18f6fd-751f-4a70-88b8-678eca326268 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] VM Started (Lifecycle Event)
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:17:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:17:00 user nova-compute[72992]: INFO nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Took 7.66 seconds to spawn the instance on the hypervisor.
Aug 15 21:17:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:00 user nova-compute[72992]: INFO nova.compute.manager [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Took 8.55 seconds to build instance.
Aug 15 21:17:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b8bb52f-a03c-4687-b642-9ee3e3294431 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.667s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'flavor' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:04 user nova-compute[72992]: INFO nova.compute.manager [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Attaching volume a0f3845b-ed4b-46e0-9fb8-45dec943fbbe to /dev/vdb
Aug 15 21:17:04 user nova-compute[72992]: DEBUG os_brick.utils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa882ab-9c62-4b77-8e9c-501a8182c8ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7dddb5-857c-4f86-8a79-47e22ac7df3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[538891d0-d165-47a5-94c4-88a152ee7129]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a510a7-e503-4b81-ac2c-6b175da2862b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:17:05 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59afaa1-04a0-4895-8320-6400e58e716c]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG os_brick.utils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating existing volume attachment record: 2ef93656-594d-4099-9404-d6d516f77b3d {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:17:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=25.733020782470703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 412a57dc-d6a0-44ec-a661-05fed5309955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bd51cb75-790e-4c23-8c48-a3de273b900f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 914c0df8-2c4e-4aa4-80d6-fc21886abc8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance ac18f6fd-751f-4a70-88b8-678eca326268 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:17:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:17:09 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:17:09 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:17:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:17:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:17:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:12 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating instance_info_cache with network_info: [{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:17:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:17:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:17:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:17:13 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134218.1254463, 9bc3a41b-c56e-41db-9897-bd9f7554869d => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:13 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] VM Stopped (Lifecycle Event)
Aug 15 21:17:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662f2e6e-e919-4cbf-8f3f-5e69e5ed4d84 None None] [instance: 9bc3a41b-c56e-41db-9897-bd9f7554869d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIQBsCtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:17:15 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:17:15 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:17:15 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[212078d6-cc61-42ea-81ee-c5f1f197bfc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:17:15 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba0942-8070-4698-8050-6e49f8e391c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe] added
Aug 15 21:17:15 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d9657f-618c-48b2-b090-32d929b66056]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dfc2ba-8cf7-4589-9f93-e8f6efc545d1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIQBsCtv {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIQBsCtv" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c3d2c2-528f-4c64-b98f-ddbd8168c746]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aIQBsCtv'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a8af4-6bc9-4da6-b5f2-68e6437687b0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aea635-dfcd-40c3-a862-24bfc9cc3245]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[14486f29-2001-4bd4-88b1-058ba5aae777]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260]
Aug 15 21:17:15 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260] successful.
Aug 15 21:17:15 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe5beb-07ce-441e-b224-5ed125763bd0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1934e465-7be9-43b1-94cc-b61e21eadcd1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:15 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b7b4f3-909a-4d4a-8ac8-08eb6777ee4d]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:17:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIQBsCtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:17:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:17:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26661323939396634', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:17:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661323939396634', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:17:16 user nova-compute[72992]: DEBUG nova.objects.instance [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'flavor' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:17:17 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:17:17 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:17:17 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:17:17 user nova-compute[72992]:   <serial>a0f3845b-ed4b-46e0-9fb8-45dec943fbbe</serial>
Aug 15 21:17:17 user nova-compute[72992]: </disk>
Aug 15 21:17:17 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:17:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:17:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:17:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No VIF found with MAC fa:16:3e:fc:74:38, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:17:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7500205c-e8eb-4e2e-8849-a4c9248dd756 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.753s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:18 user nova-compute[72992]: INFO nova.compute.manager [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Rescuing
Aug 15 21:17:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-3198576d-3488-4754-bbf0-546562aa84d2 req-37883526-24ee-40a4-89ef-4bb1d04c4208 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3198576d-3488-4754-bbf0-546562aa84d2 req-37883526-24ee-40a4-89ef-4bb1d04c4208 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3198576d-3488-4754-bbf0-546562aa84d2 req-37883526-24ee-40a4-89ef-4bb1d04c4208 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3198576d-3488-4754-bbf0-546562aa84d2 req-37883526-24ee-40a4-89ef-4bb1d04c4208 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-3198576d-3488-4754-bbf0-546562aa84d2 req-37883526-24ee-40a4-89ef-4bb1d04c4208 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:19 user nova-compute[72992]: WARNING nova.compute.manager [req-3198576d-3488-4754-bbf0-546562aa84d2 req-37883526-24ee-40a4-89ef-4bb1d04c4208 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state active and task_state rescuing.
Aug 15 21:17:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance destroyed successfully.
Aug 15 21:17:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Attempting a stable device rescue
Aug 15 21:17:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72992) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:17:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Creating image(s)
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "57043fc3a338f26cd74f049ab35953200c283dcf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "57043fc3a338f26cd74f049ab35953200c283dcf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-5535a444-01c9-4f57-a4ba-cb71bd977e66 req-271debbd-4f61-4b7b-b3a0-e1c8a551b0c0 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5535a444-01c9-4f57-a4ba-cb71bd977e66 req-271debbd-4f61-4b7b-b3a0-e1c8a551b0c0 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5535a444-01c9-4f57-a4ba-cb71bd977e66 req-271debbd-4f61-4b7b-b3a0-e1c8a551b0c0 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5535a444-01c9-4f57-a4ba-cb71bd977e66 req-271debbd-4f61-4b7b-b3a0-e1c8a551b0c0 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-5535a444-01c9-4f57-a4ba-cb71bd977e66 req-271debbd-4f61-4b7b-b3a0-e1c8a551b0c0 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:21 user nova-compute[72992]: WARNING nova.compute.manager [req-5535a444-01c9-4f57-a4ba-cb71bd977e66 req-271debbd-4f61-4b7b-b3a0-e1c8a551b0c0 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state active and task_state rescuing.
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.part --force-share --output=json" returned: 0 in 0.203s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG nova.virt.images [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] 8e77669c-04ba-484f-9ddf-cc63589c22ea was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.part /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.part /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.converted" returned: 0 in 0.210s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquired lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'info_cache' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "57043fc3a338f26cd74f049ab35953200c283dcf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.063s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "57043fc3a338f26cd74f049ab35953200c283dcf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "57043fc3a338f26cd74f049ab35953200c283dcf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf --force-share --output=json" returned: 0 in 0.212s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf,backing_fmt=raw /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf,backing_fmt=raw /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue" returned: 0 in 0.074s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "57043fc3a338f26cd74f049ab35953200c283dcf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'migration_context' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Start _get_guest_xml network_info=[{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "vif_mac": "fa:16:3e:fc:74:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8e77669c-04ba-484f-9ddf-cc63589c22ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIQBsCtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd7297eef-0545-4a9b-bc17-0cc9eed179d0', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0f3845b-ed4b-46e0-9fb8-45dec943fbbe', 'serial': 'a0f3845b-ed4b-46e0-9fb8-45dec943fbbe'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '2ef93656-594d-4099-9404-d6d516f77b3d', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'resources' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'numa_topology' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:17:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:17:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIQBsCtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:17:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:17:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:17:22 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4702ce1-fb3e-4292-9037-3411d291ff2a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aIQBsCtv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 21:17:22 user nova-compute[72992]: node.name = iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe
Aug 15 21:17:22 user nova-compute[72992]: node.tpgt = -1
Aug 15 21:17:22 user nova-compute[72992]: node.startup = automatic
Aug 15 21:17:22 user nova-compute[72992]: node.leading_login = No
Aug 15 21:17:22 user nova-compute[72992]: iface.iscsi_ifacename = default
Aug 15 21:17:22 user nova-compute[72992]: iface.net_ifacename = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.ipaddress = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.prefix_len = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.hwaddress = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.transport_name = tcp
Aug 15 21:17:22 user nova-compute[72992]: iface.initiatorname = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.state = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.vlan_id = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.vlan_priority = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.vlan_state = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.iface_num = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.mtu = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.port = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.bootproto = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.subnet_mask = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.gateway = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_alt_client_id = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_dns = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_learn_iqn = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_vendor_id_state = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_vendor_id = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.dhcp_slp_da = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.fragmentation = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.gratuitous_arp = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.incoming_forwarding = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.tos_state = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.tos = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.ttl = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.delayed_ack = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.tcp_nagle = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.tcp_wsf_state = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.tcp_wsf = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.tcp_timer_scale = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.tcp_timestamp = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.redirect = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.def_task_mgmt_timeout = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.header_digest = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.data_digest = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.immediate_data = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.initial_r2t = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.data_seq_inorder = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.data_pdu_inorder = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.erl = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.max_receive_data_len = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.first_burst_len = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.max_outstanding_r2t = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.max_burst_len = 0
Aug 15 21:17:22 user nova-compute[72992]: iface.chap_auth = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.bidi_chap = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.strict_login_compliance = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.discovery_auth = <empty>
Aug 15 21:17:22 user nova-compute[72992]: iface.discovery_logout = <empty>
Aug 15 21:17:22 user nova-compute[72992]: node.discovery_address = <empty>
Aug 15 21:17:22 user nova-compute[72992]: node.discovery_port = 0
Aug 15 21:17:22 user nova-compute[72992]: node.discovery_type = static
Aug 15 21:17:22 user nova-compute[72992]: node.session.initial_cmdsn = 0
Aug 15 21:17:22 user nova-compute[72992]: node.session.initial_login_retry_max = 8
Aug 15 21:17:22 user nova-compute[72992]: node.session.xmit_thread_priority = -20
Aug 15 21:17:22 user nova-compute[72992]: node.session.cmds_max = 128
Aug 15 21:17:22 user nova-compute[72992]: node.session.queue_depth = 32
Aug 15 21:17:22 user nova-compute[72992]: node.session.nr_sessions = 1
Aug 15 21:17:22 user nova-compute[72992]: node.session.auth.authmethod = CHAP
Aug 15 21:17:22 user nova-compute[72992]: node.session.auth.username = aIQBsCtv
Aug 15 21:17:22 user nova-compute[72992]: node.session.auth.password = ***
Aug 15 21:17:22 user nova-compute[72992]: node.session.auth.username_in = <empty>
Aug 15 21:17:22 user nova-compute[72992]: node.session.auth.password_in = <empty>
Aug 15 21:17:22 user nova-compute[72992]: node.session.auth.chap_algs = MD5
Aug 15 21:17:22 user nova-compute[72992]: node.session.timeo.replacement_timeout = 120
Aug 15 21:17:22 user nova-compute[72992]: node.session.err_timeo.abort_timeout = 15
Aug 15 21:17:22 user nova-compute[72992]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 21:17:22 user nova-compute[72992]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 21:17:22 user nova-compute[72992]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.FastAbort = Yes
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.InitialR2T = No
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.ImmediateData = Yes
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.MaxConnections = 1
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 21:17:22 user nova-compute[72992]: node.session.iscsi.ERL = 0
Aug 15 21:17:22 user nova-compute[72992]: node.session.scan = manual
Aug 15 21:17:22 user nova-compute[72992]: node.session.reopen_max = 0
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].address = 172.16.0.220
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].port = 3260
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].startup = manual
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].tcp.window_size = 524288
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].tcp.type_of_service = 0
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].timeo.logout_timeout = 15
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].timeo.login_timeout = 15
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].timeo.auth_timeout = 45
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].iscsi.DataDigest = None
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].iscsi.IFMarker = No
Aug 15 21:17:22 user nova-compute[72992]: node.conn[0].iscsi.OFMarker = No
Aug 15 21:17:22 user nova-compute[72992]: # END RECORD
Aug 15 21:17:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee1104-eda8-48e1-b7d9-9d46ce49a9ae]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cc8ef8-bc95-41ed-805d-fe561729031e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIQBsCtv {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIQBsCtv" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c6aad-e843-4cd9-ac18-2df7378bc2e5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aIQBsCtv'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e8c353-649a-4b38-91c8-0463b664bd2a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b57e92-5c9b-417f-8da0-4a1f23f8407c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.187s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a119c5da-3ce2-45a7-85c0-3a7eed0f904e]: (4, ('0 0 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIQBsCtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.226s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] <== connect_volume: return (228ms) {'type': 'block', 'scsi_wwn': '26661323939396634', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661323939396634', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1417900130',display_name='tempest-ServerStableDeviceRescueTest-server-1417900130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1417900130',id=5,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7ZLnoh6RIZDQRKtYGj4FQkpVRjtE7bTxS4Ap5jRyYQc2IgnS4ni63NGJQvyy6bm+dswlA4+gyM44vcpTqFbp0rgfC74Q471kAJ8u5/3xy/eZsLJvq0j61FQ1uCPDo8qg==',key_name='tempest-keypair-1784868198',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b6c8e62937043e0abe3f53fd31a3dd2',ramdisk_id='',reservation_id='r-ij95wf1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-242377571',owner_user_name='tempest-ServerStableDeviceRescueTest-242377571-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ac86e414f5945118a79507ec92a9f45',uuid=d7297eef-0545-4a9b-bc17-0cc9eed179d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "vif_mac": "fa:16:3e:fc:74:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converting VIF {"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "vif_mac": "fa:16:3e:fc:74:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'pci_devices' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:17:22 user nova-compute[72992]:   <uuid>d7297eef-0545-4a9b-bc17-0cc9eed179d0</uuid>
Aug 15 21:17:22 user nova-compute[72992]:   <name>instance-00000005</name>
Aug 15 21:17:22 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:17:22 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:17:22 user nova-compute[72992]:   <metadata>
Aug 15 21:17:22 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:17:22 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:17:22 user nova-compute[72992]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1417900130</nova:name>
Aug 15 21:17:22 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:17:22</nova:creationTime>
Aug 15 21:17:22 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:17:22 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:17:22 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:17:22 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:17:22 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:17:22 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:17:22 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:17:22 user nova-compute[72992]:       <nova:owner>
Aug 15 21:17:22 user nova-compute[72992]:         <nova:user uuid="3ac86e414f5945118a79507ec92a9f45">tempest-ServerStableDeviceRescueTest-242377571-project-member</nova:user>
Aug 15 21:17:22 user nova-compute[72992]:         <nova:project uuid="1b6c8e62937043e0abe3f53fd31a3dd2">tempest-ServerStableDeviceRescueTest-242377571</nova:project>
Aug 15 21:17:22 user nova-compute[72992]:       </nova:owner>
Aug 15 21:17:22 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:17:22 user nova-compute[72992]:       <nova:ports>
Aug 15 21:17:22 user nova-compute[72992]:         <nova:port uuid="5a2e316b-e6ab-434c-839b-5b914d72a5d4">
Aug 15 21:17:22 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:17:22 user nova-compute[72992]:         </nova:port>
Aug 15 21:17:22 user nova-compute[72992]:       </nova:ports>
Aug 15 21:17:22 user nova-compute[72992]:     </nova:instance>
Aug 15 21:17:22 user nova-compute[72992]:   </metadata>
Aug 15 21:17:22 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:17:22 user nova-compute[72992]:     <system>
Aug 15 21:17:22 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:17:22 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:17:22 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:17:22 user nova-compute[72992]:       <entry name="serial">d7297eef-0545-4a9b-bc17-0cc9eed179d0</entry>
Aug 15 21:17:22 user nova-compute[72992]:       <entry name="uuid">d7297eef-0545-4a9b-bc17-0cc9eed179d0</entry>
Aug 15 21:17:22 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:17:22 user nova-compute[72992]:     </system>
Aug 15 21:17:22 user nova-compute[72992]:   </sysinfo>
Aug 15 21:17:22 user nova-compute[72992]:   <os>
Aug 15 21:17:22 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:17:22 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:17:22 user nova-compute[72992]:   </os>
Aug 15 21:17:22 user nova-compute[72992]:   <features>
Aug 15 21:17:22 user nova-compute[72992]:     <acpi/>
Aug 15 21:17:22 user nova-compute[72992]:     <apic/>
Aug 15 21:17:22 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:17:22 user nova-compute[72992]:   </features>
Aug 15 21:17:22 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:17:22 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:17:22 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:17:22 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:17:22 user nova-compute[72992]:   </clock>
Aug 15 21:17:22 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:17:22 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:17:22 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:17:22 user nova-compute[72992]:   </cpu>
Aug 15 21:17:22 user nova-compute[72992]:   <devices>
Aug 15 21:17:22 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:17:22 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:17:22 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk"/>
Aug 15 21:17:22 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:17:22 user nova-compute[72992]:     </disk>
Aug 15 21:17:22 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:17:22 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:17:22 user nova-compute[72992]:       <source dev="/dev/sdc"/>
Aug 15 21:17:22 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:17:22 user nova-compute[72992]:       <serial>a0f3845b-ed4b-46e0-9fb8-45dec943fbbe</serial>
Aug 15 21:17:22 user nova-compute[72992]:     </disk>
Aug 15 21:17:22 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:17:22 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:17:22 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue"/>
Aug 15 21:17:22 user nova-compute[72992]:       <target dev="vdc" bus="virtio"/>
Aug 15 21:17:22 user nova-compute[72992]:       <boot order="1"/>
Aug 15 21:17:22 user nova-compute[72992]:     </disk>
Aug 15 21:17:22 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:17:22 user nova-compute[72992]:       <mac address="fa:16:3e:fc:74:38"/>
Aug 15 21:17:22 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:17:22 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:17:22 user nova-compute[72992]:       <target dev="tap5a2e316b-e6"/>
Aug 15 21:17:22 user nova-compute[72992]:     </interface>
Aug 15 21:17:22 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:17:22 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/console.log" append="off"/>
Aug 15 21:17:22 user nova-compute[72992]:     </serial>
Aug 15 21:17:22 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:17:22 user nova-compute[72992]:     <video>
Aug 15 21:17:22 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:17:22 user nova-compute[72992]:     </video>
Aug 15 21:17:22 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:17:22 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:17:22 user nova-compute[72992]:     </rng>
Aug 15 21:17:22 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:17:22 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:17:22 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:17:22 user nova-compute[72992]:     </memballoon>
Aug 15 21:17:22 user nova-compute[72992]:   </devices>
Aug 15 21:17:22 user nova-compute[72992]: </domain>
Aug 15 21:17:22 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.network.neutron [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating instance_info_cache with network_info: [{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance destroyed successfully.
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Releasing lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:17:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance destroyed successfully.
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'resources' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_vif [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b5157e-60, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] No VIF found with MAC fa:16:3e:fc:74:38, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:22 user nova-compute[72992]: INFO os_vif [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60')
Aug 15 21:17:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjSWKHxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:17:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5afd6f5-f3ae-4892-b59e-ebc43f6ff0c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daaf06a-c06d-43c5-a3e9-6067ce82c621]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64f15630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722'): ({'sde'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Removing single pathed devices sde {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ad7f5f-9cb0-4623-8c02-33e49ac93106]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf23ed3-95f6-435c-9f93-7e17b4524626]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flushing IO for device /dev/sde {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca63f0-9601-472c-bb9b-b7236d3fe135]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[799fff94-b0de-4012-8b7b-06101d02d7fe]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:17:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f4331-8958-44b7-928a-f4027350065d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1634a1-526d-42be-81c8-0ff9d18a1995]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]
Aug 15 21:17:23 user nova-compute[72992]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.
Aug 15 21:17:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47d7b0-17eb-4840-94d5-1487c2c542d5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== disconnect_volume: return (336ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Start _get_guest_xml network_info=[{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjSWKHxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b198f99d-1575-4ac1-9f66-47d12fda99d9', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef79e12b-68d1-4205-845d-a38866af8722', 'serial': 'ef79e12b-68d1-4205-845d-a38866af8722'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '0eb38560-15cb-4e14-9adc-170db072f167', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'numa_topology' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:17:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'vcpu_model' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjSWKHxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:17:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:17:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:17:23 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fde2db-40eb-493b-ae19-d8700bb6a450]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:17:23 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[484ad953-1bdc-4476-bb68-9c8dd02ac664]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722] added
Aug 15 21:17:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3940e08-110b-45e2-92bf-f126e8d7ed2a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e1c80-eb03-4d96-bb54-c4186e7298f3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjSWKHxh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QjSWKHxh" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1339f6-7863-4671-ac1a-c0d086231b41]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QjSWKHxh'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5d967a-3cee-4e70-b596-c11fbcfbac7a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ba51f6-017d-45ef-8df5-326292ef8699]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb88b2-e140-41e2-a465-1027ba35b815]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]
Aug 15 21:17:23 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.
Aug 15 21:17:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2549428-898d-4dd9-97a1-ab1fd8c6a1b4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90f9c65-0aa5-4115-a53d-01d85dee05da]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:17:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b7952-89a5-4bf0-9cb1-fa06a76fcf24]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:17:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjSWKHxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23661316437346261', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661316437346261', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'pci_devices' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-517707e4-79ab-4d58-8574-dd45adf3b203 req-885629d7-fedd-49bc-af36-6b7f95ce3d70 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-517707e4-79ab-4d58-8574-dd45adf3b203 req-885629d7-fedd-49bc-af36-6b7f95ce3d70 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-517707e4-79ab-4d58-8574-dd45adf3b203 req-885629d7-fedd-49bc-af36-6b7f95ce3d70 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-517707e4-79ab-4d58-8574-dd45adf3b203 req-885629d7-fedd-49bc-af36-6b7f95ce3d70 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-517707e4-79ab-4d58-8574-dd45adf3b203 req-885629d7-fedd-49bc-af36-6b7f95ce3d70 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:24 user nova-compute[72992]: WARNING nova.compute.manager [req-517707e4-79ab-4d58-8574-dd45adf3b203 req-885629d7-fedd-49bc-af36-6b7f95ce3d70 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state active and task_state rescuing.
Aug 15 21:17:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:17:24 user nova-compute[72992]:   <uuid>b198f99d-1575-4ac1-9f66-47d12fda99d9</uuid>
Aug 15 21:17:24 user nova-compute[72992]:   <name>instance-00000004</name>
Aug 15 21:17:24 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:17:24 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:17:24 user nova-compute[72992]:   <metadata>
Aug 15 21:17:24 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:17:24 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:17:24 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeTestJSON-server-552553520</nova:name>
Aug 15 21:17:24 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:17:23</nova:creationTime>
Aug 15 21:17:24 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:17:24 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:17:24 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:17:24 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:17:24 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:17:24 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:17:24 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:17:24 user nova-compute[72992]:       <nova:owner>
Aug 15 21:17:24 user nova-compute[72992]:         <nova:user uuid="c6ff1260094b492086d5ae874ed7dd0d">tempest-AttachVolumeTestJSON-2136218087-project-member</nova:user>
Aug 15 21:17:24 user nova-compute[72992]:         <nova:project uuid="b55df905a9e64949ac35075fb206991e">tempest-AttachVolumeTestJSON-2136218087</nova:project>
Aug 15 21:17:24 user nova-compute[72992]:       </nova:owner>
Aug 15 21:17:24 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:17:24 user nova-compute[72992]:       <nova:ports>
Aug 15 21:17:24 user nova-compute[72992]:         <nova:port uuid="25b5157e-6099-448c-af89-cc4477901f69">
Aug 15 21:17:24 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 21:17:24 user nova-compute[72992]:         </nova:port>
Aug 15 21:17:24 user nova-compute[72992]:       </nova:ports>
Aug 15 21:17:24 user nova-compute[72992]:     </nova:instance>
Aug 15 21:17:24 user nova-compute[72992]:   </metadata>
Aug 15 21:17:24 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:17:24 user nova-compute[72992]:     <system>
Aug 15 21:17:24 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:17:24 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:17:24 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:17:24 user nova-compute[72992]:       <entry name="serial">b198f99d-1575-4ac1-9f66-47d12fda99d9</entry>
Aug 15 21:17:24 user nova-compute[72992]:       <entry name="uuid">b198f99d-1575-4ac1-9f66-47d12fda99d9</entry>
Aug 15 21:17:24 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:17:24 user nova-compute[72992]:     </system>
Aug 15 21:17:24 user nova-compute[72992]:   </sysinfo>
Aug 15 21:17:24 user nova-compute[72992]:   <os>
Aug 15 21:17:24 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:17:24 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:17:24 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:17:24 user nova-compute[72992]:   </os>
Aug 15 21:17:24 user nova-compute[72992]:   <features>
Aug 15 21:17:24 user nova-compute[72992]:     <acpi/>
Aug 15 21:17:24 user nova-compute[72992]:     <apic/>
Aug 15 21:17:24 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:17:24 user nova-compute[72992]:   </features>
Aug 15 21:17:24 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:17:24 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:17:24 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:17:24 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:17:24 user nova-compute[72992]:   </clock>
Aug 15 21:17:24 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:17:24 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:17:24 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:17:24 user nova-compute[72992]:   </cpu>
Aug 15 21:17:24 user nova-compute[72992]:   <devices>
Aug 15 21:17:24 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:17:24 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:17:24 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk"/>
Aug 15 21:17:24 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:17:24 user nova-compute[72992]:     </disk>
Aug 15 21:17:24 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:17:24 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:17:24 user nova-compute[72992]:       <source dev="/dev/sdd"/>
Aug 15 21:17:24 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:17:24 user nova-compute[72992]:       <serial>ef79e12b-68d1-4205-845d-a38866af8722</serial>
Aug 15 21:17:24 user nova-compute[72992]:     </disk>
Aug 15 21:17:24 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:17:24 user nova-compute[72992]:       <mac address="fa:16:3e:d7:04:4c"/>
Aug 15 21:17:24 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:17:24 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:17:24 user nova-compute[72992]:       <target dev="tap25b5157e-60"/>
Aug 15 21:17:24 user nova-compute[72992]:     </interface>
Aug 15 21:17:24 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:17:24 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/console.log" append="off"/>
Aug 15 21:17:24 user nova-compute[72992]:     </serial>
Aug 15 21:17:24 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:17:24 user nova-compute[72992]:     <video>
Aug 15 21:17:24 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:17:24 user nova-compute[72992]:     </video>
Aug 15 21:17:24 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:17:24 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:17:24 user nova-compute[72992]:     </rng>
Aug 15 21:17:24 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:17:24 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:17:24 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:17:24 user nova-compute[72992]:     </memballoon>
Aug 15 21:17:24 user nova-compute[72992]:   </devices>
Aug 15 21:17:24 user nova-compute[72992]: </domain>
Aug 15 21:17:24 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'trusted_certs' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Cannot resize image /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.objects.instance [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'migration_context' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:15:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG os_vif [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b5157e-60, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b5157e-60, col_values=(('external_ids', {'iface-id': '25b5157e-6099-448c-af89-cc4477901f69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:04:4c', 'vm-uuid': 'b198f99d-1575-4ac1-9f66-47d12fda99d9'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:17:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:25 user nova-compute[72992]: INFO os_vif [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60')
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-f34905ef-fe1e-464e-9c5d-c86b7e4653f9 req-ae5eede0-0799-4a1c-9348-73e2705500b5 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f34905ef-fe1e-464e-9c5d-c86b7e4653f9 req-ae5eede0-0799-4a1c-9348-73e2705500b5 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f34905ef-fe1e-464e-9c5d-c86b7e4653f9 req-ae5eede0-0799-4a1c-9348-73e2705500b5 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f34905ef-fe1e-464e-9c5d-c86b7e4653f9 req-ae5eede0-0799-4a1c-9348-73e2705500b5 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-f34905ef-fe1e-464e-9c5d-c86b7e4653f9 req-ae5eede0-0799-4a1c-9348-73e2705500b5 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:26 user nova-compute[72992]: WARNING nova.compute.manager [req-f34905ef-fe1e-464e-9c5d-c86b7e4653f9 req-ae5eede0-0799-4a1c-9348-73e2705500b5 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state active and task_state rescuing.
Aug 15 21:17:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for d7297eef-0545-4a9b-bc17-0cc9eed179d0 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134246.9140654, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:26 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] VM Resumed (Lifecycle Event)
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c3e90792-eaf2-4458-b873-a923f9b1d65f tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:17:26 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 21:17:26 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134246.9193094, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:26 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] VM Started (Lifecycle Event)
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-changed-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Refreshing instance network info cache due to event network-changed-2a6d4e92-3b86-45f5-aabb-cecde326debc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] Acquiring lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] Acquired lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.network.neutron [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Refreshing network info cache for port 2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-bc29b86c-14c6-4858-b45c-dcf5c7486d41 req-ddb7e69a-03ed-42ca-8a2b-fc7c822beadf service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bc29b86c-14c6-4858-b45c-dcf5c7486d41 req-ddb7e69a-03ed-42ca-8a2b-fc7c822beadf service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bc29b86c-14c6-4858-b45c-dcf5c7486d41 req-ddb7e69a-03ed-42ca-8a2b-fc7c822beadf service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bc29b86c-14c6-4858-b45c-dcf5c7486d41 req-ddb7e69a-03ed-42ca-8a2b-fc7c822beadf service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-bc29b86c-14c6-4858-b45c-dcf5c7486d41 req-ddb7e69a-03ed-42ca-8a2b-fc7c822beadf service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:27 user nova-compute[72992]: WARNING nova.compute.manager [req-bc29b86c-14c6-4858-b45c-dcf5c7486d41 req-ddb7e69a-03ed-42ca-8a2b-fc7c822beadf service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state stopped and task_state powering-on.
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:27 user nova-compute[72992]: INFO nova.compute.manager [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Terminating instance
Aug 15 21:17:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Updated VIF entry in instance network info cache for port 2a6d4e92-3b86-45f5-aabb-cecde326debc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Updating instance_info_cache with network_info: [{"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f2dee6fe-6e15-41a6-81b6-d27599ab82e9 req-2e4c3e5d-c09f-4d68-92ad-232a6269415f service nova] Releasing lock "refresh_cache-914c0df8-2c4e-4aa4-80d6-fc21886abc8a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:17:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Instance destroyed successfully.
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'resources' on Instance uuid 914c0df8-2c4e-4aa4-80d6-fc21886abc8a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-195497012',display_name='tempest-AttachVolumeNegativeTest-server-195497012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-195497012',id=12,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU08spH918kdcWBGTRIPwfCfVYeY9sBFA5UbcDzdXSWukfXsSaae7t8DjnNe5ulJzZ4/DSb7f0u7OUCHh3I9GeO4jM7bYSlNI63TD7EOq/65T5CpQnuRktrqjUX77JPVA==',key_name='tempest-keypair-1938965096',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-ghak2kp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=914c0df8-2c4e-4aa4-80d6-fc21886abc8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "address": "fa:16:3e:e5:26:85", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a6d4e92-3b", "ovs_interfaceid": "2a6d4e92-3b86-45f5-aabb-cecde326debc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:26:85,bridge_name='br-int',has_traffic_filtering=True,id=2a6d4e92-3b86-45f5-aabb-cecde326debc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6d4e92-3b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG os_vif [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:26:85,bridge_name='br-int',has_traffic_filtering=True,id=2a6d4e92-3b86-45f5-aabb-cecde326debc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6d4e92-3b') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a6d4e92-3b, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:17:28 user nova-compute[72992]: INFO os_vif [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:26:85,bridge_name='br-int',has_traffic_filtering=True,id=2a6d4e92-3b86-45f5-aabb-cecde326debc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a6d4e92-3b')
Aug 15 21:17:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Deleting instance files /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a_del
Aug 15 21:17:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Deletion of /opt/stack/data/nova/instances/914c0df8-2c4e-4aa4-80d6-fc21886abc8a_del complete
Aug 15 21:17:28 user nova-compute[72992]: INFO nova.compute.manager [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 21:17:28 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:17:28 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-vif-unplugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] Acquiring lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] No waiting events found dispatching network-vif-unplugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-vif-unplugged-2a6d4e92-3b86-45f5-aabb-cecde326debc for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] Acquiring lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] No waiting events found dispatching network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:29 user nova-compute[72992]: WARNING nova.compute.manager [req-c617d646-5951-43e4-b539-f03bb0d0e9fb req-1e17939f-b42f-46c4-adb4-b1e7320c1c86 service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received unexpected event network-vif-plugged-2a6d4e92-3b86-45f5-aabb-cecde326debc for instance with vm_state active and task_state deleting.
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134249.6924708, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Resumed (Lifecycle Event)
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:17:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance rebooted successfully.
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-451138d4-76cb-46a0-beab-8de522c7e802 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:17:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134249.6945808, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Started (Lifecycle Event)
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-d477c5fa-c7d0-477f-a46c-ddc3601daaa7 req-6ef26dd4-8122-4fa0-b2dd-055ad433a1c5 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d477c5fa-c7d0-477f-a46c-ddc3601daaa7 req-6ef26dd4-8122-4fa0-b2dd-055ad433a1c5 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d477c5fa-c7d0-477f-a46c-ddc3601daaa7 req-6ef26dd4-8122-4fa0-b2dd-055ad433a1c5 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d477c5fa-c7d0-477f-a46c-ddc3601daaa7 req-6ef26dd4-8122-4fa0-b2dd-055ad433a1c5 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-d477c5fa-c7d0-477f-a46c-ddc3601daaa7 req-6ef26dd4-8122-4fa0-b2dd-055ad433a1c5 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:29 user nova-compute[72992]: WARNING nova.compute.manager [req-d477c5fa-c7d0-477f-a46c-ddc3601daaa7 req-6ef26dd4-8122-4fa0-b2dd-055ad433a1c5 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state stopped and task_state powering-on.
Aug 15 21:17:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 21:17:31 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:31 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Took 2.23 seconds to deallocate network for instance.
Aug 15 21:17:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:31 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:17:31 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:17:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:31 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Deleted allocations for instance 914c0df8-2c4e-4aa4-80d6-fc21886abc8a
Aug 15 21:17:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e0729973-6452-4daf-b05e-81c7fa87af6d tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "914c0df8-2c4e-4aa4-80d6-fc21886abc8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.859s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-bdcdffde-57cd-4013-b280-3bda1ce187b7 req-fcf0cfef-2f12-451e-9d3e-98861532d07c service nova] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Received event network-vif-deleted-2a6d4e92-3b86-45f5-aabb-cecde326debc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:36 user nova-compute[72992]: INFO nova.compute.manager [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Terminating instance
Aug 15 21:17:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-c9de8312-ea6a-48cb-b48a-cd9064d2f388 req-02b6a673-3e12-4e14-9805-d4bf3eefa815 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-vif-unplugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c9de8312-ea6a-48cb-b48a-cd9064d2f388 req-02b6a673-3e12-4e14-9805-d4bf3eefa815 service nova] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c9de8312-ea6a-48cb-b48a-cd9064d2f388 req-02b6a673-3e12-4e14-9805-d4bf3eefa815 service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c9de8312-ea6a-48cb-b48a-cd9064d2f388 req-02b6a673-3e12-4e14-9805-d4bf3eefa815 service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.031s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-c9de8312-ea6a-48cb-b48a-cd9064d2f388 req-02b6a673-3e12-4e14-9805-d4bf3eefa815 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] No waiting events found dispatching network-vif-unplugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-c9de8312-ea6a-48cb-b48a-cd9064d2f388 req-02b6a673-3e12-4e14-9805-d4bf3eefa815 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-vif-unplugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:17:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Instance destroyed successfully.
Aug 15 21:17:37 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lazy-loading 'resources' on Instance uuid bd51cb75-790e-4c23-8c48-a3de273b900f {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-987850189',display_name='tempest-TestVolumeSwap-server-987850189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-987850189',id=10,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLB6wVGQVbpUMWHv5g1RzSm/+1RmlbXCKK5oEcU0yvCbNH8YcTKWlkVhMqb1gzAPnKBSH5q2FfAG5tIuu+moO19ebHGf9PInf6aUP22yiGynu1wg5m7ElVVfEAMoLdWaw==',key_name='tempest-keypair-164681680',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0aa5ec24cfc4e43935a90a8ac5cbe52',ramdisk_id='',reservation_id='r-podsb8zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1778895763',owner_user_name='tempest-TestVolumeSwap-1778895763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:14:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0188ea63e796441294fe121527359a12',uuid=bd51cb75-790e-4c23-8c48-a3de273b900f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Converting VIF {"id": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "address": "fa:16:3e:18:c5:8d", "network": {"id": "b4e6963b-327c-45a0-b17c-b28ebddefa97", "bridge": "br-int", "label": "tempest-TestVolumeSwap-859480342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0aa5ec24cfc4e43935a90a8ac5cbe52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f6e4fe9-7e", "ovs_interfaceid": "0f6e4fe9-7e44-4003-90c7-54196c955c0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:c5:8d,bridge_name='br-int',has_traffic_filtering=True,id=0f6e4fe9-7e44-4003-90c7-54196c955c0d,network=Network(b4e6963b-327c-45a0-b17c-b28ebddefa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e4fe9-7e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG os_vif [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:c5:8d,bridge_name='br-int',has_traffic_filtering=True,id=0f6e4fe9-7e44-4003-90c7-54196c955c0d,network=Network(b4e6963b-327c-45a0-b17c-b28ebddefa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e4fe9-7e') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f6e4fe9-7e, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:17:37 user nova-compute[72992]: INFO os_vif [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:c5:8d,bridge_name='br-int',has_traffic_filtering=True,id=0f6e4fe9-7e44-4003-90c7-54196c955c0d,network=Network(b4e6963b-327c-45a0-b17c-b28ebddefa97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f6e4fe9-7e')
Aug 15 21:17:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Deleting instance files /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f_del
Aug 15 21:17:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Deletion of /opt/stack/data/nova/instances/bd51cb75-790e-4c23-8c48-a3de273b900f_del complete
Aug 15 21:17:38 user nova-compute[72992]: INFO nova.compute.manager [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 21:17:38 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:17:38 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:17:38 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-c55458dd-95ac-4d88-b94b-2e21cd8a6d10 req-4ce5ac22-b008-4b48-955f-4e3ff28aa870 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c55458dd-95ac-4d88-b94b-2e21cd8a6d10 req-4ce5ac22-b008-4b48-955f-4e3ff28aa870 service nova] Acquiring lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c55458dd-95ac-4d88-b94b-2e21cd8a6d10 req-4ce5ac22-b008-4b48-955f-4e3ff28aa870 service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c55458dd-95ac-4d88-b94b-2e21cd8a6d10 req-4ce5ac22-b008-4b48-955f-4e3ff28aa870 service nova] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-c55458dd-95ac-4d88-b94b-2e21cd8a6d10 req-4ce5ac22-b008-4b48-955f-4e3ff28aa870 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] No waiting events found dispatching network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:17:39 user nova-compute[72992]: WARNING nova.compute.manager [req-c55458dd-95ac-4d88-b94b-2e21cd8a6d10 req-4ce5ac22-b008-4b48-955f-4e3ff28aa870 service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received unexpected event network-vif-plugged-0f6e4fe9-7e44-4003-90c7-54196c955c0d for instance with vm_state active and task_state deleting.
Aug 15 21:17:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:39 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Took 1.86 seconds to deallocate network for instance.
Aug 15 21:17:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-25a069ad-bcf6-4f84-b5c9-e6abdda80f14 req-abacd484-f474-4baa-8108-8b011afcd49b service nova] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Received event network-vif-deleted-0f6e4fe9-7e44-4003-90c7-54196c955c0d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:40 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:17:40 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:17:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:40 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Deleted allocations for instance bd51cb75-790e-4c23-8c48-a3de273b900f
Aug 15 21:17:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e5a3d6b8-2ada-41c6-8071-e3dc9f8b00d3 tempest-TestVolumeSwap-1778895763 tempest-TestVolumeSwap-1778895763-project-member] Lock "bd51cb75-790e-4c23-8c48-a3de273b900f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.860s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:43 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134248.7680633, 914c0df8-2c4e-4aa4-80d6-fc21886abc8a => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:43 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] VM Stopped (Lifecycle Event)
Aug 15 21:17:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a5c9f907-06dd-44a2-9592-ab96343ebf6f None None] [instance: 914c0df8-2c4e-4aa4-80d6-fc21886abc8a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:17:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:17:47 user nova-compute[72992]: INFO nova.compute.claims [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Claim successful on node user
Aug 15 21:17:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:48 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:17:48 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:17:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:17:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:17:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:17:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:17:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:17:48 user nova-compute[72992]: INFO nova.virt.block_device [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Booting with volume 3706ef9a-0e87-432b-b70b-675babea402b at /dev/vda
Aug 15 21:17:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[26951295-761e-490e-ba32-b3cbb9c07d19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c839d-516c-400f-a113-6edb950b71b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[502d4498-fe6a-4802-9dc1-aacc6444cfb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6bf340-2d3f-498b-a827-a3aed66dd364]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:17:49 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:17:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2f4fb-372e-4a11-b27d-42bf34cc0cba]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating existing volume attachment record: aaa2c646-d544-4c26-bb9c-a974d978416f {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:17:49 user nova-compute[72992]: DEBUG nova.policy [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '908a8f34f6054d1a806d9e6dfc8ba0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b36c330bfb4288b96178f25e8820ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:17:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully created port: 12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:17:51 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully created port: 045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:17:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:51 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully created port: a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:17:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully created port: 660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:17:52 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134257.9021873, bd51cb75-790e-4c23-8c48-a3de273b900f => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:17:52 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] VM Stopped (Lifecycle Event)
Aug 15 21:17:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-479ecf4e-bfbd-4a18-972e-10b20d915ebb None None] [instance: bd51cb75-790e-4c23-8c48-a3de273b900f] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:17:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully created port: ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully updated port: 12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG nova.compute.manager [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG nova.compute.manager [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-12d0e7a1-0166-465c-87c4-b0dd9525132a. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port 12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-84fdf2ab-f562-489b-9c1a-1b33fee50a23 req-9f213fe0-edbc-4088-8c87-b4db09c51618 service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:17:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully updated port: 3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:17:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:17:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:17:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:17:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:17:55 user nova-compute[72992]: INFO nova.compute.claims [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Claim successful on node user
Aug 15 21:17:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port 3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:17:56 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:17:56 user nova-compute[72992]: INFO nova.virt.block_device [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Booting with volume 78d304ae-d80d-4559-a63b-97fb29ea960e at /dev/vda
Aug 15 21:17:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.policy [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44b6f1facf97472fb22015645ce76a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c2b71054a944de87abfb5fad8101d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully updated port: d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[989a5eb0-df9a-45c4-bafc-f410411f6a9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d739ee2f-7043-475c-b0d3-b6ae9cfe652b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38cf778-2e0c-47bf-bac4-a7157bc2bcc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd298291-f0aa-416a-a0cd-717993bb96e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63546659-5fd7-4c23-b7a9-ce124ccdb99f req-a2697363-8659-4317-8f8b-a7e473b2958e service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:17:56 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:17:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[832fa8f1-6b3d-4dcf-9f11-b8220bb1c4f1]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:17:56 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating existing volume attachment record: 76fa75b5-553a-4717-91c1-7b4b0ac48de0 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:17:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Successfully created port: 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-d2b77738-b77c-44cf-85d2-402c2663d723. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully updated port: 045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:17:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-21609c49-1e46-42e8-a18d-41f86d9e07d6 req-b56e0a75-e47a-4f86-a9bd-439060009c22 service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:17:59 user nova-compute[72992]: INFO nova.virt.block_device [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Booting with volume 95161330-40d2-4e21-9b7b-0a32eeddd1f7 at /dev/vdb
Aug 15 21:17:59 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e61372c-4fd4-4ff5-a59d-0d19016373dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed14b9b-c679-4a36-93df-b60987cfbbcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc3d9b-f3fd-466c-89c1-9ed336b3e0a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce157bf7-929f-4117-900d-527614e0555a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:00 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b454fd06-c33a-4f28-8a86-a127a57e7fd2]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating existing volume attachment record: a9cb1d8d-997b-498b-8a01-b5959199b838 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Successfully updated port: 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-045a49a9-5c44-4b81-b37d-99316d965b65. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port 045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully updated port: a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing instance network info cache due to event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance network_info: |[{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG nova.network.neutron [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG nova.network.neutron [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updated VIF entry in instance network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG nova.network.neutron [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-942815f6-16e1-4a97-bfc6-69233f2bf785 req-0d4d6a72-a0e7-4792-bc5f-5a156e574fa0 service nova] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully updated port: 660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-660278b3-4b40-47e9-a1d2-5a28a6614bfb. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port 660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Successfully updated port: ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG nova.network.neutron [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eb16e240-8c3d-4363-81ca-a577b60aa532 req-ed3a7376-2bca-4f49-9c0e-b8d3e8c33a22 service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:18:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:04 user nova-compute[72992]: INFO nova.compute.manager [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Rescuing
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG nova.network.neutron [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-ad9fc02d-ae92-408a-be5a-30857baeffb8. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json" returned: 0 in 0.282s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-8baddc01-4b4c-45c8-bc30-f751ee591c06 req-b6dfafd8-0eaf-45d6-b772-347186718fc3 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8baddc01-4b4c-45c8-bc30-f751ee591c06 req-b6dfafd8-0eaf-45d6-b772-347186718fc3 service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8baddc01-4b4c-45c8-bc30-f751ee591c06 req-b6dfafd8-0eaf-45d6-b772-347186718fc3 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8baddc01-4b4c-45c8-bc30-f751ee591c06 req-b6dfafd8-0eaf-45d6-b772-347186718fc3 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-8baddc01-4b4c-45c8-bc30-f751ee591c06 req-b6dfafd8-0eaf-45d6-b772-347186718fc3 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:05 user nova-compute[72992]: WARNING nova.compute.manager [req-8baddc01-4b4c-45c8-bc30-f751ee591c06 req-b6dfafd8-0eaf-45d6-b772-347186718fc3 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state active and task_state rescuing.
Aug 15 21:18:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance destroyed successfully.
Aug 15 21:18:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Attempting rescue
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72992) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:18:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Creating image(s)
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'trusted_certs' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [{"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance network_info: |[{"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.network.neutron [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:06 user nova-compute[72992]: INFO nova.compute.manager [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Rescuing
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue" returned: 0 in 0.069s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'migration_context' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Start _get_guest_xml network_info=[{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:68:1e:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'resources' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'numa_topology' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-976509570',display_name='tempest-ServerRescueNegativeTestJSON-server-976509570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-976509570',id=3,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-pu00chv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:13:37Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=a6e7c604-49e8-47af-a81f-2da89401ea96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:68:1e:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:68:1e:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'pci_devices' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:18:07 user nova-compute[72992]:   <uuid>a6e7c604-49e8-47af-a81f-2da89401ea96</uuid>
Aug 15 21:18:07 user nova-compute[72992]:   <name>instance-00000003</name>
Aug 15 21:18:07 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:18:07 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:18:07 user nova-compute[72992]:   <metadata>
Aug 15 21:18:07 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:18:07 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:18:07 user nova-compute[72992]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-976509570</nova:name>
Aug 15 21:18:07 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:18:06</nova:creationTime>
Aug 15 21:18:07 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:18:07 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:18:07 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:18:07 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:18:07 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:18:07 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:18:07 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:18:07 user nova-compute[72992]:       <nova:owner>
Aug 15 21:18:07 user nova-compute[72992]:         <nova:user uuid="08a032f1741f46ee814186f61b82aac4">tempest-ServerRescueNegativeTestJSON-600517153-project-member</nova:user>
Aug 15 21:18:07 user nova-compute[72992]:         <nova:project uuid="664606f930f446fabae71df899c94da5">tempest-ServerRescueNegativeTestJSON-600517153</nova:project>
Aug 15 21:18:07 user nova-compute[72992]:       </nova:owner>
Aug 15 21:18:07 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:18:07 user nova-compute[72992]:       <nova:ports>
Aug 15 21:18:07 user nova-compute[72992]:         <nova:port uuid="a0331ed5-5162-4b9a-bb4e-9f28a4657d6c">
Aug 15 21:18:07 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:18:07 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:07 user nova-compute[72992]:       </nova:ports>
Aug 15 21:18:07 user nova-compute[72992]:     </nova:instance>
Aug 15 21:18:07 user nova-compute[72992]:   </metadata>
Aug 15 21:18:07 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:18:07 user nova-compute[72992]:     <system>
Aug 15 21:18:07 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:18:07 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:18:07 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:18:07 user nova-compute[72992]:       <entry name="serial">a6e7c604-49e8-47af-a81f-2da89401ea96</entry>
Aug 15 21:18:07 user nova-compute[72992]:       <entry name="uuid">a6e7c604-49e8-47af-a81f-2da89401ea96</entry>
Aug 15 21:18:07 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:18:07 user nova-compute[72992]:     </system>
Aug 15 21:18:07 user nova-compute[72992]:   </sysinfo>
Aug 15 21:18:07 user nova-compute[72992]:   <os>
Aug 15 21:18:07 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:18:07 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:18:07 user nova-compute[72992]:   </os>
Aug 15 21:18:07 user nova-compute[72992]:   <features>
Aug 15 21:18:07 user nova-compute[72992]:     <acpi/>
Aug 15 21:18:07 user nova-compute[72992]:     <apic/>
Aug 15 21:18:07 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:18:07 user nova-compute[72992]:   </features>
Aug 15 21:18:07 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:18:07 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:18:07 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:18:07 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:18:07 user nova-compute[72992]:   </clock>
Aug 15 21:18:07 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:18:07 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:18:07 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:18:07 user nova-compute[72992]:   </cpu>
Aug 15 21:18:07 user nova-compute[72992]:   <devices>
Aug 15 21:18:07 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:18:07 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:18:07 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue"/>
Aug 15 21:18:07 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:18:07 user nova-compute[72992]:     </disk>
Aug 15 21:18:07 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:18:07 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:18:07 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk"/>
Aug 15 21:18:07 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:18:07 user nova-compute[72992]:     </disk>
Aug 15 21:18:07 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:07 user nova-compute[72992]:       <mac address="fa:16:3e:68:1e:f7"/>
Aug 15 21:18:07 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:07 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:07 user nova-compute[72992]:       <target dev="tapa0331ed5-51"/>
Aug 15 21:18:07 user nova-compute[72992]:     </interface>
Aug 15 21:18:07 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:18:07 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/console.log" append="off"/>
Aug 15 21:18:07 user nova-compute[72992]:     </serial>
Aug 15 21:18:07 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:18:07 user nova-compute[72992]:     <video>
Aug 15 21:18:07 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:07 user nova-compute[72992]:     </video>
Aug 15 21:18:07 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:18:07 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:18:07 user nova-compute[72992]:     </rng>
Aug 15 21:18:07 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:18:07 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:18:07 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:18:07 user nova-compute[72992]:     </memballoon>
Aug 15 21:18:07 user nova-compute[72992]:   </devices>
Aug 15 21:18:07 user nova-compute[72992]: </domain>
Aug 15 21:18:07 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:18:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance destroyed successfully.
Aug 15 21:18:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No VIF found with MAC fa:16:3e:68:1e:f7, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating instance_info_cache with network_info: [{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.network.neutron [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updated VIF entry in instance network info cache for port ad9fc02d-ae92-408a-be5a-30857baeffb8. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG nova.network.neutron [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [{"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0722e215-b2c9-43fa-b63e-8f58a95736b4 req-4e068a3f-2a7f-45a1-87a1-349532223abd service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdafec0-92ab-4fc6-a1bd-9996552d1560 req-99f2bf2f-0524-4f9c-98b0-a5d555eddf43 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdafec0-92ab-4fc6-a1bd-9996552d1560 req-99f2bf2f-0524-4f9c-98b0-a5d555eddf43 service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdafec0-92ab-4fc6-a1bd-9996552d1560 req-99f2bf2f-0524-4f9c-98b0-a5d555eddf43 service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdafec0-92ab-4fc6-a1bd-9996552d1560 req-99f2bf2f-0524-4f9c-98b0-a5d555eddf43 service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdafec0-92ab-4fc6-a1bd-9996552d1560 req-99f2bf2f-0524-4f9c-98b0-a5d555eddf43 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:08 user nova-compute[72992]: WARNING nova.compute.manager [req-1cdafec0-92ab-4fc6-a1bd-9996552d1560 req-99f2bf2f-0524-4f9c-98b0-a5d555eddf43 service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state active and task_state rescuing.
Aug 15 21:18:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-ddcd15fd-4afa-43b5-b8e6-f759bad659b9 req-655cac83-09c0-4205-9cbf-32817c9378d3 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ddcd15fd-4afa-43b5-b8e6-f759bad659b9 req-655cac83-09c0-4205-9cbf-32817c9378d3 service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ddcd15fd-4afa-43b5-b8e6-f759bad659b9 req-655cac83-09c0-4205-9cbf-32817c9378d3 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ddcd15fd-4afa-43b5-b8e6-f759bad659b9 req-655cac83-09c0-4205-9cbf-32817c9378d3 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-ddcd15fd-4afa-43b5-b8e6-f759bad659b9 req-655cac83-09c0-4205-9cbf-32817c9378d3 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:08 user nova-compute[72992]: WARNING nova.compute.manager [req-ddcd15fd-4afa-43b5-b8e6-f759bad659b9 req-655cac83-09c0-4205-9cbf-32817c9378d3 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state active and task_state rescuing.
Aug 15 21:18:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance destroyed successfully.
Aug 15 21:18:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Attempting a stable device rescue
Aug 15 21:18:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72992) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:18:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Creating image(s)
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "/opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "e20b165265c9f11423f11d3b9203c98a056f848b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e20b165265c9f11423f11d3b9203c98a056f848b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-425a7341-1d0c-4759-a327-d556fa0082b3 req-9cb3965e-3e9d-40aa-a70c-c43f3b47a66c service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-425a7341-1d0c-4759-a327-d556fa0082b3 req-9cb3965e-3e9d-40aa-a70c-c43f3b47a66c service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-425a7341-1d0c-4759-a327-d556fa0082b3 req-9cb3965e-3e9d-40aa-a70c-c43f3b47a66c service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-425a7341-1d0c-4759-a327-d556fa0082b3 req-9cb3965e-3e9d-40aa-a70c-c43f3b47a66c service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-425a7341-1d0c-4759-a327-d556fa0082b3 req-9cb3965e-3e9d-40aa-a70c-c43f3b47a66c service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:10 user nova-compute[72992]: WARNING nova.compute.manager [req-425a7341-1d0c-4759-a327-d556fa0082b3 req-9cb3965e-3e9d-40aa-a70c-c43f3b47a66c service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state active and task_state rescuing.
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:10 user nova-compute[72992]: WARNING nova.compute.manager [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state active and task_state rescuing.
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:10 user nova-compute[72992]: WARNING nova.compute.manager [req-54fb007c-d039-46ea-bd42-c4393b2c2efa req-a004d355-85d2-4f93-a554-e6ef939b044f service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state active and task_state rescuing.
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.part --force-share --output=json" returned: 0 in 0.281s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.virt.images [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] 576d5dd6-4165-466d-9e11-f47edca42bc9 was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.part /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json" returned: 0 in 0.309s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.part /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.converted" returned: 0 in 0.875s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:18:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Creating image(s)
Aug 15 21:18:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Ensure instance console log exists: /opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Start _get_guest_xml network_info=[{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ee81390-8064-4a06-893e-d5238e4b06bc', 'attached_at': '', 'detached_at': '', 'volume_id': '78d304ae-d80d-4559-a63b-97fb29ea960e', 'serial': '78d304ae-d80d-4559-a63b-97fb29ea960e'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '76fa75b5-553a-4717-91c1-7b4b0ac48de0', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for a6e7c604-49e8-47af-a81f-2da89401ea96 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134292.38435, a6e7c604-49e8-47af-a81f-2da89401ea96 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:12 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] VM Resumed (Lifecycle Event)
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-73af34f4-b52f-4219-aa24-588bd1099a2d tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b.converted --force-share --output=json" returned: 0 in 0.918s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e20b165265c9f11423f11d3b9203c98a056f848b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.572s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "e20b165265c9f11423f11d3b9203c98a056f848b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e20b165265c9f11423f11d3b9203c98a056f848b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:12 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:12 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7630MB free_disk=25.64159393310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:12 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:12 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:12 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:12 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:12 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:18:12 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134292.3849745, a6e7c604-49e8-47af-a81f-2da89401ea96 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:12 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] VM Started (Lifecycle Event)
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd3111-0275-49a1-aafa-706b817658dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:12 user nova-compute[72992]: INFO nova.virt.block_device [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Booting with volume 4597718e-cb14-457b-aa34-76cea15e73c2 at /dev/vdc
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:18:12 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b --force-share --output=json" returned: 0 in 0.222s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b,backing_fmt=raw /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.rescue {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[862dc2b2-8bc8-421d-9b99-7457412f0dc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e] added
Aug 15 21:18:12 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b,backing_fmt=raw /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.rescue" returned: 0 in 0.077s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e20b165265c9f11423f11d3b9203c98a056f848b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'migration_context' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3412ac1c-adea-4c9b-8d50-e80cce4ebe61]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Start _get_guest_xml network_info=[{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "vif_mac": "fa:16:3e:a7:cd:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '576d5dd6-4165-466d-9e11-f47edca42bc9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTfIbozS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '76c6d54f-938e-42a0-84d6-659e38f21bb8', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc8b823a-18b7-45fe-ae25-205baff0ac43', 'serial': 'cc8b823a-18b7-45fe-ae25-205baff0ac43'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'cbd02412-a146-4ba2-a2ac-da7fae0b322b', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'resources' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 412a57dc-d6a0-44ec-a661-05fed5309955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance ac18f6fd-751f-4a70-88b8-678eca326268 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5b5143db-39e5-4962-a85d-fe6cd0cdb45d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 9ee81390-8064-4a06-893e-d5238e4b06bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d72c37-2687-4922-8f58-95dbdfe133ea]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'numa_topology' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcegjNQA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:12 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcegjNQA" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea2721-bbec-453d-82ec-6156784eeba4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcegjNQA'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ead55f-808d-4dba-8cb6-04d81cfe60b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4a0f87-fe89-4bef-97bc-9022d0c98b3f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3246219-47da-4412-8c25-9474a97ac740]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTfIbozS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:13 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f78d0-23ca-4aa4-9444-c67e7ddad142]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0aacb-6231-4092-b1ad-b178747dfee4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2600aa-1ece-4cfb-a5a2-f4cd80b03fa2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edce787-7ff8-4fa7-b12f-9e23f31a7d73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]
Aug 15 21:18:13 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.
Aug 15 21:18:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:13 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc53215-606a-4b98-9120-8d6e29140851]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating existing volume attachment record: d0f713eb-1b61-4987-a874-da0d4da899ab {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb86a4c-caff-4d90-b9bb-29a85ccba4d8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e76fc0-d790-47b8-869c-cad06a77d009]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:13 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422c901-142c-452d-ae8a-0850ee6e20d6]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:18:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.932s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '26135636265326338', 'path': '/dev/sde'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135636265326338', 'path': '/dev/sde'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.229s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:14 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:14 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef5269-3e58-4ae5-8f85-58525f4b17cf]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aTfIbozS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 21:18:14 user nova-compute[72992]: node.name = iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43
Aug 15 21:18:14 user nova-compute[72992]: node.tpgt = -1
Aug 15 21:18:14 user nova-compute[72992]: node.startup = automatic
Aug 15 21:18:14 user nova-compute[72992]: node.leading_login = No
Aug 15 21:18:14 user nova-compute[72992]: iface.iscsi_ifacename = default
Aug 15 21:18:14 user nova-compute[72992]: iface.net_ifacename = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.ipaddress = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.prefix_len = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.hwaddress = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.transport_name = tcp
Aug 15 21:18:14 user nova-compute[72992]: iface.initiatorname = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.state = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.vlan_id = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.vlan_priority = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.vlan_state = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.iface_num = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.mtu = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.port = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.bootproto = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.subnet_mask = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.gateway = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_alt_client_id = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_dns = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_learn_iqn = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_vendor_id_state = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_vendor_id = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.dhcp_slp_da = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.fragmentation = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.gratuitous_arp = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.incoming_forwarding = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.tos_state = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.tos = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.ttl = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.delayed_ack = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.tcp_nagle = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.tcp_wsf_state = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.tcp_wsf = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.tcp_timer_scale = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.tcp_timestamp = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.redirect = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.def_task_mgmt_timeout = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.header_digest = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.data_digest = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.immediate_data = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.initial_r2t = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.data_seq_inorder = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.data_pdu_inorder = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.erl = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.max_receive_data_len = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.first_burst_len = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.max_outstanding_r2t = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.max_burst_len = 0
Aug 15 21:18:14 user nova-compute[72992]: iface.chap_auth = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.bidi_chap = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.strict_login_compliance = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.discovery_auth = <empty>
Aug 15 21:18:14 user nova-compute[72992]: iface.discovery_logout = <empty>
Aug 15 21:18:14 user nova-compute[72992]: node.discovery_address = <empty>
Aug 15 21:18:14 user nova-compute[72992]: node.discovery_port = 0
Aug 15 21:18:14 user nova-compute[72992]: node.discovery_type = static
Aug 15 21:18:14 user nova-compute[72992]: node.session.initial_cmdsn = 0
Aug 15 21:18:14 user nova-compute[72992]: node.session.initial_login_retry_max = 8
Aug 15 21:18:14 user nova-compute[72992]: node.session.xmit_thread_priority = -20
Aug 15 21:18:14 user nova-compute[72992]: node.session.cmds_max = 128
Aug 15 21:18:14 user nova-compute[72992]: node.session.queue_depth = 32
Aug 15 21:18:14 user nova-compute[72992]: node.session.nr_sessions = 1
Aug 15 21:18:14 user nova-compute[72992]: node.session.auth.authmethod = CHAP
Aug 15 21:18:14 user nova-compute[72992]: node.session.auth.username = aTfIbozS
Aug 15 21:18:14 user nova-compute[72992]: node.session.auth.password = ***
Aug 15 21:18:14 user nova-compute[72992]: node.session.auth.username_in = <empty>
Aug 15 21:18:14 user nova-compute[72992]: node.session.auth.password_in = <empty>
Aug 15 21:18:14 user nova-compute[72992]: node.session.auth.chap_algs = MD5
Aug 15 21:18:14 user nova-compute[72992]: node.session.timeo.replacement_timeout = 120
Aug 15 21:18:14 user nova-compute[72992]: node.session.err_timeo.abort_timeout = 15
Aug 15 21:18:14 user nova-compute[72992]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 21:18:14 user nova-compute[72992]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 21:18:14 user nova-compute[72992]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.FastAbort = Yes
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.InitialR2T = No
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.ImmediateData = Yes
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.MaxConnections = 1
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 21:18:14 user nova-compute[72992]: node.session.iscsi.ERL = 0
Aug 15 21:18:14 user nova-compute[72992]: node.session.scan = manual
Aug 15 21:18:14 user nova-compute[72992]: node.session.reopen_max = 0
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].address = 172.16.0.220
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].port = 3260
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].startup = manual
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].tcp.window_size = 524288
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].tcp.type_of_service = 0
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].timeo.logout_timeout = 15
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].timeo.login_timeout = 15
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].timeo.auth_timeout = 45
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].iscsi.DataDigest = None
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].iscsi.IFMarker = No
Aug 15 21:18:14 user nova-compute[72992]: node.conn[0].iscsi.OFMarker = No
Aug 15 21:18:14 user nova-compute[72992]: # END RECORD
Aug 15 21:18:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-273239992',display_name='tempest-TestShelveInstance-server-273239992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-273239992',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLairPAAwvAX2jiTJ099QyJUqxtL2jIpk9nCo2wSzOMbPg5kCoaKE2Ih7euYv4rQIUeKBc2YSt299/p/DDBMFtMYqkgkMYnk8rDscE3tTkzwkKhsjwR83q0qfFNRi1XYQ==',key_name='tempest-TestShelveInstance-172315357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c2b71054a944de87abfb5fad8101d1',ramdisk_id='',reservation_id='r-7jqfcmob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-526170969',owner_user_name='tempest-TestShelveInstance-526170969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:57Z,user_data=None,user_id='44b6f1facf97472fb22015645ce76a82',uuid=9ee81390-8064-4a06-893e-d5238e4b06bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converting VIF {"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf30979-34c5-47c7-aec2-7ee8cd2ed000]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:18:14 user nova-compute[72992]:   <uuid>9ee81390-8064-4a06-893e-d5238e4b06bc</uuid>
Aug 15 21:18:14 user nova-compute[72992]:   <name>instance-00000010</name>
Aug 15 21:18:14 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:18:14 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:18:14 user nova-compute[72992]:   <metadata>
Aug 15 21:18:14 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:18:14 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:name>tempest-TestShelveInstance-server-273239992</nova:name>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:18:12</nova:creationTime>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:18:14 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:18:14 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:owner>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:user uuid="44b6f1facf97472fb22015645ce76a82">tempest-TestShelveInstance-526170969-project-member</nova:user>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:project uuid="52c2b71054a944de87abfb5fad8101d1">tempest-TestShelveInstance-526170969</nova:project>
Aug 15 21:18:14 user nova-compute[72992]:       </nova:owner>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:ports>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:port uuid="438b1af6-fce1-4c3e-a0c6-f20be618e1c3">
Aug 15 21:18:14 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:18:14 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:14 user nova-compute[72992]:       </nova:ports>
Aug 15 21:18:14 user nova-compute[72992]:     </nova:instance>
Aug 15 21:18:14 user nova-compute[72992]:   </metadata>
Aug 15 21:18:14 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:18:14 user nova-compute[72992]:     <system>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="serial">9ee81390-8064-4a06-893e-d5238e4b06bc</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="uuid">9ee81390-8064-4a06-893e-d5238e4b06bc</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:18:14 user nova-compute[72992]:     </system>
Aug 15 21:18:14 user nova-compute[72992]:   </sysinfo>
Aug 15 21:18:14 user nova-compute[72992]:   <os>
Aug 15 21:18:14 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:18:14 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:18:14 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:18:14 user nova-compute[72992]:   </os>
Aug 15 21:18:14 user nova-compute[72992]:   <features>
Aug 15 21:18:14 user nova-compute[72992]:     <acpi/>
Aug 15 21:18:14 user nova-compute[72992]:     <apic/>
Aug 15 21:18:14 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:18:14 user nova-compute[72992]:   </features>
Aug 15 21:18:14 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:18:14 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:18:14 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:18:14 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:18:14 user nova-compute[72992]:   </clock>
Aug 15 21:18:14 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:18:14 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:18:14 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:18:14 user nova-compute[72992]:   </cpu>
Aug 15 21:18:14 user nova-compute[72992]:   <devices>
Aug 15 21:18:14 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:18:14 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:14 user nova-compute[72992]:       <source dev="/dev/sde"/>
Aug 15 21:18:14 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:18:14 user nova-compute[72992]:       <serial>78d304ae-d80d-4559-a63b-97fb29ea960e</serial>
Aug 15 21:18:14 user nova-compute[72992]:     </disk>
Aug 15 21:18:14 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:14 user nova-compute[72992]:       <mac address="fa:16:3e:ba:c7:bf"/>
Aug 15 21:18:14 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:14 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:14 user nova-compute[72992]:       <target dev="tap438b1af6-fc"/>
Aug 15 21:18:14 user nova-compute[72992]:     </interface>
Aug 15 21:18:14 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:18:14 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc/console.log" append="off"/>
Aug 15 21:18:14 user nova-compute[72992]:     </serial>
Aug 15 21:18:14 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:18:14 user nova-compute[72992]:     <video>
Aug 15 21:18:14 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:14 user nova-compute[72992]:     </video>
Aug 15 21:18:14 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:18:14 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:18:14 user nova-compute[72992]:     </rng>
Aug 15 21:18:14 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:18:14 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:18:14 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:18:14 user nova-compute[72992]:     </memballoon>
Aug 15 21:18:14 user nova-compute[72992]:   </devices>
Aug 15 21:18:14 user nova-compute[72992]: </domain>
Aug 15 21:18:14 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-273239992',display_name='tempest-TestShelveInstance-server-273239992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-273239992',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLairPAAwvAX2jiTJ099QyJUqxtL2jIpk9nCo2wSzOMbPg5kCoaKE2Ih7euYv4rQIUeKBc2YSt299/p/DDBMFtMYqkgkMYnk8rDscE3tTkzwkKhsjwR83q0qfFNRi1XYQ==',key_name='tempest-TestShelveInstance-172315357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52c2b71054a944de87abfb5fad8101d1',ramdisk_id='',reservation_id='r-7jqfcmob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-526170969',owner_user_name='tempest-TestShelveInstance-526170969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:57Z,user_data=None,user_id='44b6f1facf97472fb22015645ce76a82',uuid=9ee81390-8064-4a06-893e-d5238e4b06bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converting VIF {"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_vif [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap438b1af6-fc, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap438b1af6-fc, col_values=(('external_ids', {'iface-id': '438b1af6-fce1-4c3e-a0c6-f20be618e1c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:c7:bf', 'vm-uuid': '9ee81390-8064-4a06-893e-d5238e4b06bc'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad212247-6db8-429c-a48a-989fa9f0856e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTfIbozS {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:14 user nova-compute[72992]: INFO os_vif [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc')
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aTfIbozS" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8409a260-c6a6-4b7f-9b45-fff5c24fcbd9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aTfIbozS'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[890480e4-eb34-4f31-ad7d-43db8d8db33d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] No VIF found with MAC fa:16:3e:ba:c7:bf, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[56282157-3e5d-48f3-9028-60ea7da94eb3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:14 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] HCTL ('33', '0', '0', 0) found on session 12 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d417d92a-a6a3-410a-ba0d-bd066f890146]: (4, ('0 0 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching for a device in session 12 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTfIbozS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.430s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== connect_volume: return (1659ms) {'type': 'block', 'scsi_wwn': '23537633737613939', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537633737613939', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-76923475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-76923475',id=13,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-oaaa8jg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:16:39Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=76c6d54f-938e-42a0-84d6-659e38f21bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "vif_mac": "fa:16:3e:a7:cd:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "vif_mac": "fa:16:3e:a7:cd:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'pci_devices' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:18:14 user nova-compute[72992]:   <uuid>76c6d54f-938e-42a0-84d6-659e38f21bb8</uuid>
Aug 15 21:18:14 user nova-compute[72992]:   <name>instance-0000000d</name>
Aug 15 21:18:14 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:18:14 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:18:14 user nova-compute[72992]:   <metadata>
Aug 15 21:18:14 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:18:14 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-76923475</nova:name>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:18:12</nova:creationTime>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:18:14 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:18:14 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:owner>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:user uuid="96dac56448a242a7817193b06d3ac23f">tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member</nova:user>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:project uuid="c0d4659b5fec441f894388f4379fb182">tempest-ServerBootFromVolumeStableRescueTest-47310148</nova:project>
Aug 15 21:18:14 user nova-compute[72992]:       </nova:owner>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:18:14 user nova-compute[72992]:       <nova:ports>
Aug 15 21:18:14 user nova-compute[72992]:         <nova:port uuid="d06857b3-fd39-47f1-b65d-02d8461f4de8">
Aug 15 21:18:14 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 21:18:14 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:14 user nova-compute[72992]:       </nova:ports>
Aug 15 21:18:14 user nova-compute[72992]:     </nova:instance>
Aug 15 21:18:14 user nova-compute[72992]:   </metadata>
Aug 15 21:18:14 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:18:14 user nova-compute[72992]:     <system>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="serial">76c6d54f-938e-42a0-84d6-659e38f21bb8</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="uuid">76c6d54f-938e-42a0-84d6-659e38f21bb8</entry>
Aug 15 21:18:14 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:18:14 user nova-compute[72992]:     </system>
Aug 15 21:18:14 user nova-compute[72992]:   </sysinfo>
Aug 15 21:18:14 user nova-compute[72992]:   <os>
Aug 15 21:18:14 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:18:14 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:18:14 user nova-compute[72992]:   </os>
Aug 15 21:18:14 user nova-compute[72992]:   <features>
Aug 15 21:18:14 user nova-compute[72992]:     <acpi/>
Aug 15 21:18:14 user nova-compute[72992]:     <apic/>
Aug 15 21:18:14 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:18:14 user nova-compute[72992]:   </features>
Aug 15 21:18:14 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:18:14 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:18:14 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:18:14 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:18:14 user nova-compute[72992]:   </clock>
Aug 15 21:18:14 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:18:14 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:18:14 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:18:14 user nova-compute[72992]:   </cpu>
Aug 15 21:18:14 user nova-compute[72992]:   <devices>
Aug 15 21:18:14 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:18:14 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:14 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:18:14 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:18:14 user nova-compute[72992]:       <serial>cc8b823a-18b7-45fe-ae25-205baff0ac43</serial>
Aug 15 21:18:14 user nova-compute[72992]:     </disk>
Aug 15 21:18:14 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:18:14 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:18:14 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.rescue"/>
Aug 15 21:18:14 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:18:14 user nova-compute[72992]:       <boot order="1"/>
Aug 15 21:18:14 user nova-compute[72992]:     </disk>
Aug 15 21:18:14 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:14 user nova-compute[72992]:       <mac address="fa:16:3e:a7:cd:25"/>
Aug 15 21:18:14 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:14 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:14 user nova-compute[72992]:       <target dev="tapd06857b3-fd"/>
Aug 15 21:18:14 user nova-compute[72992]:     </interface>
Aug 15 21:18:14 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:18:14 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/console.log" append="off"/>
Aug 15 21:18:14 user nova-compute[72992]:     </serial>
Aug 15 21:18:14 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:18:14 user nova-compute[72992]:     <video>
Aug 15 21:18:14 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:14 user nova-compute[72992]:     </video>
Aug 15 21:18:14 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:18:14 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:18:14 user nova-compute[72992]:     </rng>
Aug 15 21:18:14 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:18:14 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:18:14 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:18:14 user nova-compute[72992]:     </memballoon>
Aug 15 21:18:14 user nova-compute[72992]:   </devices>
Aug 15 21:18:14 user nova-compute[72992]: </domain>
Aug 15 21:18:14 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:18:14 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance destroyed successfully.
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No VIF found with MAC fa:16:3e:a7:cd:25, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:18:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-71a5c25d-9684-4f59-88c7-531c3594b027 req-986f08c1-dba6-46b6-9077-4d7c3a87821e service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71a5c25d-9684-4f59-88c7-531c3594b027 req-986f08c1-dba6-46b6-9077-4d7c3a87821e service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71a5c25d-9684-4f59-88c7-531c3594b027 req-986f08c1-dba6-46b6-9077-4d7c3a87821e service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71a5c25d-9684-4f59-88c7-531c3594b027 req-986f08c1-dba6-46b6-9077-4d7c3a87821e service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-71a5c25d-9684-4f59-88c7-531c3594b027 req-986f08c1-dba6-46b6-9077-4d7c3a87821e service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:17 user nova-compute[72992]: WARNING nova.compute.manager [req-71a5c25d-9684-4f59-88c7-531c3594b027 req-986f08c1-dba6-46b6-9077-4d7c3a87821e service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received unexpected event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with vm_state building and task_state spawning.
Aug 15 21:18:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-26fbc8ae-43a6-4c98-9580-2836e9674062 req-be94e893-a1b9-41ef-a770-4767923c9a7b service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-26fbc8ae-43a6-4c98-9580-2836e9674062 req-be94e893-a1b9-41ef-a770-4767923c9a7b service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-26fbc8ae-43a6-4c98-9580-2836e9674062 req-be94e893-a1b9-41ef-a770-4767923c9a7b service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-26fbc8ae-43a6-4c98-9580-2836e9674062 req-be94e893-a1b9-41ef-a770-4767923c9a7b service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-26fbc8ae-43a6-4c98-9580-2836e9674062 req-be94e893-a1b9-41ef-a770-4767923c9a7b service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:17 user nova-compute[72992]: WARNING nova.compute.manager [req-26fbc8ae-43a6-4c98-9580-2836e9674062 req-be94e893-a1b9-41ef-a770-4767923c9a7b service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state active and task_state rescuing.
Aug 15 21:18:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ec3a806-362d-4d73-a82d-574e658c1842 req-774de66b-4642-4dc1-b141-cc3ab2c307a7 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ec3a806-362d-4d73-a82d-574e658c1842 req-774de66b-4642-4dc1-b141-cc3ab2c307a7 service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ec3a806-362d-4d73-a82d-574e658c1842 req-774de66b-4642-4dc1-b141-cc3ab2c307a7 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ec3a806-362d-4d73-a82d-574e658c1842 req-774de66b-4642-4dc1-b141-cc3ab2c307a7 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ec3a806-362d-4d73-a82d-574e658c1842 req-774de66b-4642-4dc1-b141-cc3ab2c307a7 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:19 user nova-compute[72992]: WARNING nova.compute.manager [req-4ec3a806-362d-4d73-a82d-574e658c1842 req-774de66b-4642-4dc1-b141-cc3ab2c307a7 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received unexpected event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with vm_state building and task_state spawning.
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-63db1d6d-fda5-472a-93ae-e6659e11e8a5 req-b22c46e4-cd41-4dd1-a4f7-535ac19f619f service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63db1d6d-fda5-472a-93ae-e6659e11e8a5 req-b22c46e4-cd41-4dd1-a4f7-535ac19f619f service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63db1d6d-fda5-472a-93ae-e6659e11e8a5 req-b22c46e4-cd41-4dd1-a4f7-535ac19f619f service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63db1d6d-fda5-472a-93ae-e6659e11e8a5 req-b22c46e4-cd41-4dd1-a4f7-535ac19f619f service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-63db1d6d-fda5-472a-93ae-e6659e11e8a5 req-b22c46e4-cd41-4dd1-a4f7-535ac19f619f service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:20 user nova-compute[72992]: WARNING nova.compute.manager [req-63db1d6d-fda5-472a-93ae-e6659e11e8a5 req-b22c46e4-cd41-4dd1-a4f7-535ac19f619f service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state active and task_state rescuing.
Aug 15 21:18:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.compute.manager [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Detaching volume b22eee57-a519-4312-88c2-56ce3ce936c7
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.virt.block_device [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Attempting to driver detach volume b22eee57-a519-4312-88c2-56ce3ce936c7 from mountpoint /dev/vdb
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Attempting to detach device vdb from instance 412a57dc-d6a0-44ec-a661-05fed5309955 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:18:20 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:20 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:18:20 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:18:20 user nova-compute[72992]:   <serial>b22eee57-a519-4312-88c2-56ce3ce936c7</serial>
Aug 15 21:18:20 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:18:20 user nova-compute[72992]: </disk>
Aug 15 21:18:20 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully detached device vdb from instance 412a57dc-d6a0-44ec-a661-05fed5309955 from the persistent domain config.
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 412a57dc-d6a0-44ec-a661-05fed5309955 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:18:20 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:20 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:18:20 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:18:20 user nova-compute[72992]:   <serial>b22eee57-a519-4312-88c2-56ce3ce936c7</serial>
Aug 15 21:18:20 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:18:20 user nova-compute[72992]: </disk>
Aug 15 21:18:20 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for 76c6d54f-938e-42a0-84d6-659e38f21bb8 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134300.732896, 76c6d54f-938e-42a0-84d6-659e38f21bb8 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] VM Resumed (Lifecycle Event)
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c476231c-601f-47dd-a5e9-05f83feaaee0 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134300.7331376, 76c6d54f-938e-42a0-84d6-659e38f21bb8 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] VM Started (Lifecycle Event)
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134300.971296, 9ee81390-8064-4a06-893e-d5238e4b06bc => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] VM Resumed (Lifecycle Event)
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:18:20 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance spawned successfully.
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:18:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134300.9730306, 9ee81390-8064-4a06-893e-d5238e4b06bc => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] VM Started (Lifecycle Event)
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 412a57dc-d6a0-44ec-a661-05fed5309955 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Took 9.44 seconds to spawn the instance on the hypervisor.
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134301.0957768, 412a57dc-d6a0-44ec-a661-05fed5309955 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:18:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully detached device vdb from instance 412a57dc-d6a0-44ec-a661-05fed5309955 from the live domain config.
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqrsYKUd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:21 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0c4809-fa23-4026-94fb-b3203bd85e5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58953d5-b308-4ad2-846f-e3d889a7254d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:21 user nova-compute[72992]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 (non-flash)
Aug 15 21:18:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64ed9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7'): ({'sdf'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Removing single pathed devices sdf {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:18:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Took 25.53 seconds to build instance.
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e7b72d-1da1-46a8-b879-7d7bc07aad2b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e05201b-308a-4e34-a9e4-be2a977cf5ae tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.660s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4886e09-b2b5-45d6-83ec-f35dd1c6f411]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flushing IO for device /dev/sdf {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2698f248-5677-4552-a93b-d760ec32cc88]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[041d41c9-3916-41c6-86a8-cef4044fb0e5]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.096s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e99080-019e-40bc-acd1-b5c53333cd16]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e89fdd-d6c9-4a7a-8d0b-b0c5acb1c7a9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260]
Aug 15 21:18:21 user nova-compute[72992]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7, portal: 172.16.0.220,3260] successful.
Aug 15 21:18:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22eee57-a519-4312-88c2-56ce3ce936c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3bb9d7-75c8-4bbd-813c-3edae9a434c0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== disconnect_volume: return (474ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid 412a57dc-d6a0-44ec-a661-05fed5309955 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64e297b4-b142-4147-a14c-52d44432ae35 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.403s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:18:25 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Creating image(s)
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Start _get_guest_xml network_info=[{"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwBJEjxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d', 'attached_at': '', 'detached_at': '', 'volume_id': '3706ef9a-0e87-432b-b70b-675babea402b', 'serial': '3706ef9a-0e87-432b-b70b-675babea402b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'aaa2c646-d544-4c26-bb9c-a974d978416f', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIQNYgCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d', 'attached_at': '', 'detached_at': '', 'volume_id': '95161330-40d2-4e21-9b7b-0a32eeddd1f7', 'serial': '95161330-40d2-4e21-9b7b-0a32eeddd1f7'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'a9cb1d8d-997b-498b-8a01-b5959199b838', 'volume_type': None}, {'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vITJKodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d', 'attached_at': '', 'detached_at': '', 'volume_id': '4597718e-cb14-457b-aa34-76cea15e73c2', 'serial': '4597718e-cb14-457b-aa34-76cea15e73c2'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'd0f713eb-1b61-4987-a874-da0d4da899ab', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:18:25 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:25 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwBJEjxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:25 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:25 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:25 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39d8e25-2f98-4564-bbc1-4f73f929d73f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:18:25 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[310f83af-efcd-45bc-a45e-f3c2e69145f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b] added
Aug 15 21:18:25 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[81181caa-e586-4299-9882-356daa164e17]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8bd7c4-a971-4446-a34c-01e888e6bf47]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwBJEjxL {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwBJEjxL" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b8975c-369a-4fd2-8693-0eeb79481762]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bwBJEjxL'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0b57b-d6a5-414d-82a6-4003f89217fb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1862b8-d7b4-4a55-8e90-e8c7cc5d3ba2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:25 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:25 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:25 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:25 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:25 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:25 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:25 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:25 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eb1d91-7fc6-4b8b-a21f-217d72ca983f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260]
Aug 15 21:18:26 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260] successful.
Aug 15 21:18:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[903fb76b-f7eb-4cb2-a63e-1812aa05e563]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5862e8da-21ca-49c9-9dd7-86cf4f654211]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:26 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8f45b3-6e60-4778-bce1-c1a1a727b2ce]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwBJEjxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:18:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23330346235653633', 'path': '/dev/sdf'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330346235653633', 'path': '/dev/sdf'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIQNYgCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:27 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:27 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:27 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d171097-9c1f-4367-8926-3d573c2f452e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:18:27 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f14e711-c8fd-4366-a978-41d2fa3749e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7] added
Aug 15 21:18:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272038e-77f5-41d8-bd92-0abcc134ab36]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[655b0809-dcdc-4447-939d-a520f76aaf1b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIQNYgCl {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIQNYgCl" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcfc35f-df97-49d1-8e6b-48324572dc4c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kIQNYgCl'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d69fe-40c1-477d-afe9-a55b648da75f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4527c66b-0dfd-4178-a383-f6a7ed8e0673]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ad1b1-bfdb-4461-9ef3-d44fae4db9ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260]
Aug 15 21:18:27 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260] successful.
Aug 15 21:18:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf26526-9a5a-423c-bdde-33a216c31a27]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ae25e9-423f-4228-9f3f-a59e065efa81]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:27 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:27 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[03313b05-4108-4757-b733-01ae4e81eddf]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:27 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIQNYgCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26638316631333333', 'path': '/dev/sdg'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638316631333333', 'path': '/dev/sdg'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vITJKodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:28 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:28 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:28 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e9fc94-91bf-4242-97a1-313c46f29d0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:18:28 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c9a760-2a39-4ee0-a5cb-7f22386d2325]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2] added
Aug 15 21:18:28 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[543a7b94-dab8-409a-bc3b-aaad20624930]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0498504f-c2a7-424e-ad32-07ad473bed0a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vITJKodf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vITJKodf" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e4d250-ecaa-41ae-a2da-62ee2b947bb4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vITJKodf'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[434e0a77-901c-44bf-bc97-ffd536b3bef8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f15638-9409-4178-b3c0-9c27a25eab1e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f202ffdb-72a8-41e6-895b-d8d7e155819e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260]
Aug 15 21:18:28 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260] successful.
Aug 15 21:18:28 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ae272d-6fd0-4e0a-8db1-c49c62c8c6db]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e789e-d5ae-4f55-9cdb-845ca376d39b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:18:28 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:18:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:29 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[113472e2-d927-4c2d-a274-ae9bd92f92eb]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:29 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:18:29 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vITJKodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:18:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26563626638316361', 'path': '/dev/sdh'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563626638316361', 'path': '/dev/sdh'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:19:bc,bridge_name='br-int',has_traffic_filtering=True,id=12d0e7a1-0166-465c-87c4-b0dd9525132a,network=Network(9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d0e7a1-01') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:55:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c8ccf12-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:08:d6,bridge_name='br-int',has_traffic_filtering=True,id=d2b77738-b77c-44cf-85d2-402c2663d723,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2b77738-b7') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=045a49a9-5c44-4b81-b37d-99316d965b65,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045a49a9-5c') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:e9:67,bridge_name='br-int',has_traffic_filtering=True,id=a4b22d64-79d0-4ead-b8e9-a055a80e4fdf,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b22d64-79') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:56,bridge_name='br-int',has_traffic_filtering=True,id=660278b3-4b40-47e9-a1d2-5a28a6614bfb,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660278b3-4b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5d:4b,bridge_name='br-int',has_traffic_filtering=True,id=ad9fc02d-ae92-408a-be5a-30857baeffb8,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9fc02d-ae') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5143db-39e5-4962-a85d-fe6cd0cdb45d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:18:30 user nova-compute[72992]:   <uuid>5b5143db-39e5-4962-a85d-fe6cd0cdb45d</uuid>
Aug 15 21:18:30 user nova-compute[72992]:   <name>instance-0000000f</name>
Aug 15 21:18:30 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:18:30 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:18:30 user nova-compute[72992]:   <metadata>
Aug 15 21:18:30 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:18:30 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:18:30 user nova-compute[72992]:       <nova:name>tempest-device-tagging-server-1301252468</nova:name>
Aug 15 21:18:30 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:18:25</nova:creationTime>
Aug 15 21:18:30 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:18:30 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:18:30 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:18:30 user nova-compute[72992]:       <nova:owner>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:user uuid="908a8f34f6054d1a806d9e6dfc8ba0f7">tempest-TaggedBootDevicesTest-532422830-project-member</nova:user>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:project uuid="f9b36c330bfb4288b96178f25e8820ef">tempest-TaggedBootDevicesTest-532422830</nova:project>
Aug 15 21:18:30 user nova-compute[72992]:       </nova:owner>
Aug 15 21:18:30 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:18:30 user nova-compute[72992]:       <nova:ports>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:port uuid="12d0e7a1-0166-465c-87c4-b0dd9525132a">
Aug 15 21:18:30 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 21:18:30 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:port uuid="3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d">
Aug 15 21:18:30 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Aug 15 21:18:30 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:port uuid="d2b77738-b77c-44cf-85d2-402c2663d723">
Aug 15 21:18:30 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Aug 15 21:18:30 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:port uuid="045a49a9-5c44-4b81-b37d-99316d965b65">
Aug 15 21:18:30 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Aug 15 21:18:30 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:port uuid="a4b22d64-79d0-4ead-b8e9-a055a80e4fdf">
Aug 15 21:18:30 user nova-compute[72992]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Aug 15 21:18:30 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:port uuid="660278b3-4b40-47e9-a1d2-5a28a6614bfb">
Aug 15 21:18:30 user nova-compute[72992]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 21:18:30 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:30 user nova-compute[72992]:         <nova:port uuid="ad9fc02d-ae92-408a-be5a-30857baeffb8">
Aug 15 21:18:30 user nova-compute[72992]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 21:18:30 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:30 user nova-compute[72992]:       </nova:ports>
Aug 15 21:18:30 user nova-compute[72992]:     </nova:instance>
Aug 15 21:18:30 user nova-compute[72992]:   </metadata>
Aug 15 21:18:30 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:18:30 user nova-compute[72992]:     <system>
Aug 15 21:18:30 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:18:30 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:18:30 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:18:30 user nova-compute[72992]:       <entry name="serial">5b5143db-39e5-4962-a85d-fe6cd0cdb45d</entry>
Aug 15 21:18:30 user nova-compute[72992]:       <entry name="uuid">5b5143db-39e5-4962-a85d-fe6cd0cdb45d</entry>
Aug 15 21:18:30 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:18:30 user nova-compute[72992]:     </system>
Aug 15 21:18:30 user nova-compute[72992]:   </sysinfo>
Aug 15 21:18:30 user nova-compute[72992]:   <os>
Aug 15 21:18:30 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:18:30 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:18:30 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:18:30 user nova-compute[72992]:   </os>
Aug 15 21:18:30 user nova-compute[72992]:   <features>
Aug 15 21:18:30 user nova-compute[72992]:     <acpi/>
Aug 15 21:18:30 user nova-compute[72992]:     <apic/>
Aug 15 21:18:30 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:18:30 user nova-compute[72992]:   </features>
Aug 15 21:18:30 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:18:30 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:18:30 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:18:30 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:18:30 user nova-compute[72992]:   </clock>
Aug 15 21:18:30 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:18:30 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:18:30 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:18:30 user nova-compute[72992]:   </cpu>
Aug 15 21:18:30 user nova-compute[72992]:   <devices>
Aug 15 21:18:30 user nova-compute[72992]:     <disk type="file" device="cdrom">
Aug 15 21:18:30 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 21:18:30 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d/disk.config"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="hda" bus="ide"/>
Aug 15 21:18:30 user nova-compute[72992]:     </disk>
Aug 15 21:18:30 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:18:30 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:30 user nova-compute[72992]:       <source dev="/dev/sdf"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <serial>3706ef9a-0e87-432b-b70b-675babea402b</serial>
Aug 15 21:18:30 user nova-compute[72992]:     </disk>
Aug 15 21:18:30 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:18:30 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:30 user nova-compute[72992]:       <source dev="/dev/sdg"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <serial>95161330-40d2-4e21-9b7b-0a32eeddd1f7</serial>
Aug 15 21:18:30 user nova-compute[72992]:     </disk>
Aug 15 21:18:30 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:18:30 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:30 user nova-compute[72992]:       <source dev="/dev/sdh"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="vdc" bus="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <serial>4597718e-cb14-457b-aa34-76cea15e73c2</serial>
Aug 15 21:18:30 user nova-compute[72992]:     </disk>
Aug 15 21:18:30 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:30 user nova-compute[72992]:       <mac address="fa:16:3e:5c:19:bc"/>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="tap12d0e7a1-01"/>
Aug 15 21:18:30 user nova-compute[72992]:     </interface>
Aug 15 21:18:30 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:30 user nova-compute[72992]:       <mac address="fa:16:3e:ad:55:7c"/>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="tap3c8ccf12-2f"/>
Aug 15 21:18:30 user nova-compute[72992]:     </interface>
Aug 15 21:18:30 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:30 user nova-compute[72992]:       <mac address="fa:16:3e:77:08:d6"/>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="tapd2b77738-b7"/>
Aug 15 21:18:30 user nova-compute[72992]:     </interface>
Aug 15 21:18:30 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:30 user nova-compute[72992]:       <mac address="fa:16:3e:8b:96:bf"/>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="tap045a49a9-5c"/>
Aug 15 21:18:30 user nova-compute[72992]:     </interface>
Aug 15 21:18:30 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:30 user nova-compute[72992]:       <mac address="fa:16:3e:ce:e9:67"/>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="tapa4b22d64-79"/>
Aug 15 21:18:30 user nova-compute[72992]:     </interface>
Aug 15 21:18:30 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:30 user nova-compute[72992]:       <mac address="fa:16:3e:83:ed:56"/>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="tap660278b3-4b"/>
Aug 15 21:18:30 user nova-compute[72992]:     </interface>
Aug 15 21:18:30 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:30 user nova-compute[72992]:       <mac address="fa:16:3e:e6:5d:4b"/>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:30 user nova-compute[72992]:       <target dev="tapad9fc02d-ae"/>
Aug 15 21:18:30 user nova-compute[72992]:     </interface>
Aug 15 21:18:30 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:18:30 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d/console.log" append="off"/>
Aug 15 21:18:30 user nova-compute[72992]:     </serial>
Aug 15 21:18:30 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:18:30 user nova-compute[72992]:     <video>
Aug 15 21:18:30 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:30 user nova-compute[72992]:     </video>
Aug 15 21:18:30 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:18:30 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:18:30 user nova-compute[72992]:     </rng>
Aug 15 21:18:30 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:18:30 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:18:30 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:18:30 user nova-compute[72992]:     </memballoon>
Aug 15 21:18:30 user nova-compute[72992]:   </devices>
Aug 15 21:18:30 user nova-compute[72992]: </domain>
Aug 15 21:18:30 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:19:bc,bridge_name='br-int',has_traffic_filtering=True,id=12d0e7a1-0166-465c-87c4-b0dd9525132a,network=Network(9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d0e7a1-01') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:19:bc,bridge_name='br-int',has_traffic_filtering=True,id=12d0e7a1-0166-465c-87c4-b0dd9525132a,network=Network(9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d0e7a1-01') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12d0e7a1-01, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12d0e7a1-01, col_values=(('external_ids', {'iface-id': '12d0e7a1-0166-465c-87c4-b0dd9525132a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:19:bc', 'vm-uuid': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: INFO os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:19:bc,bridge_name='br-int',has_traffic_filtering=True,id=12d0e7a1-0166-465c-87c4-b0dd9525132a,network=Network(9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d0e7a1-01')
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:55:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c8ccf12-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:55:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c8ccf12-2f') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c8ccf12-2f, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c8ccf12-2f, col_values=(('external_ids', {'iface-id': '3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:55:7c', 'vm-uuid': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: INFO os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:55:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c8ccf12-2f')
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:08:d6,bridge_name='br-int',has_traffic_filtering=True,id=d2b77738-b77c-44cf-85d2-402c2663d723,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2b77738-b7') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:08:d6,bridge_name='br-int',has_traffic_filtering=True,id=d2b77738-b77c-44cf-85d2-402c2663d723,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2b77738-b7') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2b77738-b7, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2b77738-b7, col_values=(('external_ids', {'iface-id': 'd2b77738-b77c-44cf-85d2-402c2663d723', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:08:d6', 'vm-uuid': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: INFO os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:08:d6,bridge_name='br-int',has_traffic_filtering=True,id=d2b77738-b77c-44cf-85d2-402c2663d723,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2b77738-b7')
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=045a49a9-5c44-4b81-b37d-99316d965b65,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045a49a9-5c') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=045a49a9-5c44-4b81-b37d-99316d965b65,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045a49a9-5c') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap045a49a9-5c, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap045a49a9-5c, col_values=(('external_ids', {'iface-id': '045a49a9-5c44-4b81-b37d-99316d965b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:96:bf', 'vm-uuid': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: INFO os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=045a49a9-5c44-4b81-b37d-99316d965b65,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045a49a9-5c')
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:e9:67,bridge_name='br-int',has_traffic_filtering=True,id=a4b22d64-79d0-4ead-b8e9-a055a80e4fdf,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b22d64-79') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:e9:67,bridge_name='br-int',has_traffic_filtering=True,id=a4b22d64-79d0-4ead-b8e9-a055a80e4fdf,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b22d64-79') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4b22d64-79, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4b22d64-79, col_values=(('external_ids', {'iface-id': 'a4b22d64-79d0-4ead-b8e9-a055a80e4fdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:e9:67', 'vm-uuid': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: INFO os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:e9:67,bridge_name='br-int',has_traffic_filtering=True,id=a4b22d64-79d0-4ead-b8e9-a055a80e4fdf,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b22d64-79')
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:56,bridge_name='br-int',has_traffic_filtering=True,id=660278b3-4b40-47e9-a1d2-5a28a6614bfb,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660278b3-4b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:56,bridge_name='br-int',has_traffic_filtering=True,id=660278b3-4b40-47e9-a1d2-5a28a6614bfb,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660278b3-4b') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap660278b3-4b, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap660278b3-4b, col_values=(('external_ids', {'iface-id': '660278b3-4b40-47e9-a1d2-5a28a6614bfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ed:56', 'vm-uuid': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: INFO os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:56,bridge_name='br-int',has_traffic_filtering=True,id=660278b3-4b40-47e9-a1d2-5a28a6614bfb,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660278b3-4b')
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5d:4b,bridge_name='br-int',has_traffic_filtering=True,id=ad9fc02d-ae92-408a-be5a-30857baeffb8,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9fc02d-ae') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5d:4b,bridge_name='br-int',has_traffic_filtering=True,id=ad9fc02d-ae92-408a-be5a-30857baeffb8,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9fc02d-ae') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad9fc02d-ae, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad9fc02d-ae, col_values=(('external_ids', {'iface-id': 'ad9fc02d-ae92-408a-be5a-30857baeffb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:5d:4b', 'vm-uuid': '5b5143db-39e5-4962-a85d-fe6cd0cdb45d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:30 user nova-compute[72992]: INFO os_vif [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5d:4b,bridge_name='br-int',has_traffic_filtering=True,id=ad9fc02d-ae92-408a-be5a-30857baeffb8,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9fc02d-ae')
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] No BDM found with device name hda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] No VIF found with MAC fa:16:3e:5c:19:bc, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] No VIF found with MAC fa:16:3e:ce:e9:67, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:18:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Using config drive
Aug 15 21:18:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Creating config drive at /opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d/disk.config
Aug 15 21:18:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9iyaxsw6 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9iyaxsw6" returned: 0 in 0.090s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-dd126026-9a00-4b6a-b646-b6bf6b58e3a2 req-399ce4b5-806d-491f-acde-9bf1b049424d service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dd126026-9a00-4b6a-b646-b6bf6b58e3a2 req-399ce4b5-806d-491f-acde-9bf1b049424d service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dd126026-9a00-4b6a-b646-b6bf6b58e3a2 req-399ce4b5-806d-491f-acde-9bf1b049424d service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dd126026-9a00-4b6a-b646-b6bf6b58e3a2 req-399ce4b5-806d-491f-acde-9bf1b049424d service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-dd126026-9a00-4b6a-b646-b6bf6b58e3a2 req-399ce4b5-806d-491f-acde-9bf1b049424d service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:32 user nova-compute[72992]: WARNING nova.compute.manager [req-dd126026-9a00-4b6a-b646-b6bf6b58e3a2 req-399ce4b5-806d-491f-acde-9bf1b049424d service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a for instance with vm_state building and task_state spawning.
Aug 15 21:18:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-43e043ae-e27c-47e9-8a30-45909ebdd183 req-57012ade-98cd-4509-999a-7a6753231785 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43e043ae-e27c-47e9-8a30-45909ebdd183 req-57012ade-98cd-4509-999a-7a6753231785 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43e043ae-e27c-47e9-8a30-45909ebdd183 req-57012ade-98cd-4509-999a-7a6753231785 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43e043ae-e27c-47e9-8a30-45909ebdd183 req-57012ade-98cd-4509-999a-7a6753231785 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-43e043ae-e27c-47e9-8a30-45909ebdd183 req-57012ade-98cd-4509-999a-7a6753231785 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:33 user nova-compute[72992]: WARNING nova.compute.manager [req-43e043ae-e27c-47e9-8a30-45909ebdd183 req-57012ade-98cd-4509-999a-7a6753231785 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 for instance with vm_state building and task_state spawning.
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:34 user nova-compute[72992]: WARNING nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a for instance with vm_state building and task_state spawning.
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:34 user nova-compute[72992]: WARNING nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d for instance with vm_state building and task_state spawning.
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:34 user nova-compute[72992]: WARNING nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d for instance with vm_state building and task_state spawning.
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:34 user nova-compute[72992]: WARNING nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 for instance with vm_state building and task_state spawning.
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:34 user nova-compute[72992]: WARNING nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 for instance with vm_state building and task_state spawning.
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:34 user nova-compute[72992]: WARNING nova.compute.manager [req-b6e08b30-92e6-49f0-b5e0-357b76a740e1 req-d510f058-903d-4ce2-b9d8-016ef563c617 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf for instance with vm_state building and task_state spawning.
Aug 15 21:18:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:35 user nova-compute[72992]: WARNING nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 for instance with vm_state building and task_state spawning.
Aug 15 21:18:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:35 user nova-compute[72992]: WARNING nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 for instance with vm_state building and task_state spawning.
Aug 15 21:18:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:35 user nova-compute[72992]: WARNING nova.compute.manager [req-0fca8b53-7819-4835-8a8a-635f303e1339 req-ddd4fbcc-8194-4530-a696-def71e384fb3 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 for instance with vm_state building and task_state spawning.
Aug 15 21:18:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:37 user nova-compute[72992]: WARNING nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf for instance with vm_state building and task_state spawning.
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:37 user nova-compute[72992]: WARNING nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb for instance with vm_state building and task_state spawning.
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:37 user nova-compute[72992]: WARNING nova.compute.manager [req-2795a1c2-716f-4620-a297-053e24d3b599 req-eab77184-841b-4712-8409-e5f2ba1e6abb service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb for instance with vm_state building and task_state spawning.
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.compute.claims [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Claim successful on node user
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134317.4240973, 5b5143db-39e5-4962-a85d-fe6cd0cdb45d => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] VM Resumed (Lifecycle Event)
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance spawned successfully.
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134317.4255743, 5b5143db-39e5-4962-a85d-fe6cd0cdb45d => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] VM Started (Lifecycle Event)
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Took 11.97 seconds to spawn the instance on the hypervisor.
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.compute.manager [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Took 49.85 seconds to build instance.
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e4cdbca-9efa-49e1-b94b-ceddbfdfc29d tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.956s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:18:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:18:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:18:38 user nova-compute[72992]: INFO nova.virt.block_device [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Booting with volume cc30a2b7-9757-4c6c-96ed-f67a203c5842 at /dev/vda
Aug 15 21:18:38 user nova-compute[72992]: DEBUG nova.policy [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cebffa69e7640dabdeb9783896d23a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14274f8917c464eb2583364aac4b207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG os_brick.utils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9740f9d2-4ce1-467f-a8b1-7c4615c84fcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b98c7-5887-4646-a73f-faa936906404]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda5d7d1-7f94-4c8d-96ad-3fd80ad95cc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4179f-78cc-495e-a548-d0a78f414adf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:38 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:18:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b754a54b-98b5-45f0-b59b-5af2601f3b3d]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG os_brick.utils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updating existing volume attachment record: 6cfcf6e2-1ab0-4250-8858-449d22338121 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:18:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Successfully created port: fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Successfully updated port: fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquired lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-changed-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Refreshing instance network info cache due to event network-changed-fc5d6d0d-096f-4934-afe8-b7e58667def8. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] Acquiring lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updating instance_info_cache with network_info: [{"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Releasing lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance network_info: |[{"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] Acquired lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG nova.network.neutron [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Refreshing network info cache for port fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG nova.network.neutron [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updated VIF entry in instance network info cache for port fc5d6d0d-096f-4934-afe8-b7e58667def8. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG nova.network.neutron [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updating instance_info_cache with network_info: [{"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ba6c2ee3-13bd-4561-b1c6-ad04c4d07779 req-6031a5ad-5c1b-4cae-b054-50b1b55c8ed7 service nova] Releasing lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-changed-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Refreshing instance network info cache due to event network-changed-c7f27105-873a-43db-b06f-51242eeaf115. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] Acquiring lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] Acquired lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Refreshing network info cache for port c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "interface-ac18f6fd-751f-4a70-88b8-678eca326268-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "interface-ac18f6fd-751f-4a70-88b8-678eca326268-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'flavor' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updated VIF entry in instance network info cache for port c7f27105-873a-43db-b06f-51242eeaf115. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c09129a3-b942-4af2-95df-a3d830e0e1f8 req-c62e53d5-4e9f-4631-b448-007a75289dc9 service nova] Releasing lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'pci_requests' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:18:45 user nova-compute[72992]: DEBUG nova.policy [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e935193250644d0be567384b67f9ec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693312b581614a3cad720c85a9bf1e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:18:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:46 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Successfully created port: 08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:18:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Successfully updated port: 08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:18:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquired lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:18:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-changed-08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Refreshing instance network info cache due to event network-changed-08493643-877c-4312-95bd-f98d4bc9fb21. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:18:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] Acquiring lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Releasing lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] Acquired lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Refreshing network info cache for port 08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converting VIF {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG os_vif [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08493643-87, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08493643-87, col_values=(('external_ids', {'iface-id': '08493643-877c-4312-95bd-f98d4bc9fb21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:29:46', 'vm-uuid': 'ac18f6fd-751f-4a70-88b8-678eca326268'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:48 user nova-compute[72992]: INFO os_vif [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87')
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converting VIF {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] attach device xml: <interface type="ethernet">
Aug 15 21:18:48 user nova-compute[72992]:   <mac address="fa:16:3e:12:29:46"/>
Aug 15 21:18:48 user nova-compute[72992]:   <model type="virtio"/>
Aug 15 21:18:48 user nova-compute[72992]:   <mtu size="1442"/>
Aug 15 21:18:48 user nova-compute[72992]:   <target dev="tap08493643-87"/>
Aug 15 21:18:48 user nova-compute[72992]: </interface>
Aug 15 21:18:48 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No BDM found with device name hda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No VIF found with MAC fa:16:3e:09:74:ea, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:18:48 user nova-compute[72992]:   <nova:package version="0.0.0"/>
Aug 15 21:18:48 user nova-compute[72992]:   <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:18:48 user nova-compute[72992]:   <nova:creationTime>2023-08-15 21:18:48</nova:creationTime>
Aug 15 21:18:48 user nova-compute[72992]:   <nova:flavor name="m1.tiny">
Aug 15 21:18:48 user nova-compute[72992]:     <nova:memory>512</nova:memory>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:disk>1</nova:disk>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:swap>0</nova:swap>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:vcpus>1</nova:vcpus>
Aug 15 21:18:48 user nova-compute[72992]:   </nova:flavor>
Aug 15 21:18:48 user nova-compute[72992]:   <nova:owner>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:18:48 user nova-compute[72992]:   </nova:owner>
Aug 15 21:18:48 user nova-compute[72992]:   <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:18:48 user nova-compute[72992]:   <nova:ports>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:18:48 user nova-compute[72992]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:18:48 user nova-compute[72992]:     </nova:port>
Aug 15 21:18:48 user nova-compute[72992]:     <nova:port uuid="08493643-877c-4312-95bd-f98d4bc9fb21">
Aug 15 21:18:48 user nova-compute[72992]:       <nova:ip type="fixed" address="10.10.10.176" ipVersion="4"/>
Aug 15 21:18:48 user nova-compute[72992]:     </nova:port>
Aug 15 21:18:48 user nova-compute[72992]:   </nova:ports>
Aug 15 21:18:48 user nova-compute[72992]: </nova:instance>
Aug 15 21:18:48 user nova-compute[72992]:  {{(pid=72992) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updated VIF entry in instance network info cache for port 08493643-877c-4312-95bd-f98d4bc9fb21. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c8a289f-9c2e-419a-92ac-6d71217d30d8 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "interface-ac18f6fd-751f-4a70-88b8-678eca326268-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.250s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6319b1e1-d98c-49e7-abd8-0fdad584ce26 req-8848f75a-ff05-4e50-a6ac-90e490125081 service nova] Releasing lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-98b21e38-28ce-4fd3-b5d5-1f9626610b54 req-b1c790b2-4b23-4f14-af3a-df31a7047c69 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-98b21e38-28ce-4fd3-b5d5-1f9626610b54 req-b1c790b2-4b23-4f14-af3a-df31a7047c69 service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-98b21e38-28ce-4fd3-b5d5-1f9626610b54 req-b1c790b2-4b23-4f14-af3a-df31a7047c69 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-98b21e38-28ce-4fd3-b5d5-1f9626610b54 req-b1c790b2-4b23-4f14-af3a-df31a7047c69 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-98b21e38-28ce-4fd3-b5d5-1f9626610b54 req-b1c790b2-4b23-4f14-af3a-df31a7047c69 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:48 user nova-compute[72992]: WARNING nova.compute.manager [req-98b21e38-28ce-4fd3-b5d5-1f9626610b54 req-b1c790b2-4b23-4f14-af3a-df31a7047c69 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-08493643-877c-4312-95bd-f98d4bc9fb21 for instance with vm_state active and task_state None.
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'flavor' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:49 user nova-compute[72992]: INFO nova.compute.manager [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Attaching volume 57e80471-975f-4e1c-a38b-116d494dd606 to /dev/vdb
Aug 15 21:18:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa04c624-1733-4939-b7e0-59e4f8fbe0d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79dff8-2920-40fb-b288-f6667d9e5fd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[854c7279-19c0-45c8-a216-4dc7c3bf2998]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47610a9-0f35-46bb-acf6-50cb5480cab1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:18:49 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:18:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f4065-617f-418c-828c-bb92f0fae949]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:49 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating existing volume attachment record: d4d868f6-ede5-41fb-b690-6242037e091a {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:18:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:18:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:18:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Creating image(s)
Aug 15 21:18:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:18:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Ensure instance console log exists: /opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:18:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Start _get_guest_xml network_info=[{"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc30a2b7-9757-4c6c-96ed-f67a203c5842', 'serial': 'cc30a2b7-9757-4c6c-96ed-f67a203c5842'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '6cfcf6e2-1ab0-4250-8858-449d22338121', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-a12caaba-800e-4752-9b8c-3125851c0df6 req-d08e7b75-c570-4703-a57b-61359c525ff1 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a12caaba-800e-4752-9b8c-3125851c0df6 req-d08e7b75-c570-4703-a57b-61359c525ff1 service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a12caaba-800e-4752-9b8c-3125851c0df6 req-d08e7b75-c570-4703-a57b-61359c525ff1 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a12caaba-800e-4752-9b8c-3125851c0df6 req-d08e7b75-c570-4703-a57b-61359c525ff1 service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-a12caaba-800e-4752-9b8c-3125851c0df6 req-d08e7b75-c570-4703-a57b-61359c525ff1 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:51 user nova-compute[72992]: WARNING nova.compute.manager [req-a12caaba-800e-4752-9b8c-3125851c0df6 req-d08e7b75-c570-4703-a57b-61359c525ff1 service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-08493643-877c-4312-95bd-f98d4bc9fb21 for instance with vm_state active and task_state None.
Aug 15 21:18:51 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:51 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:18:51 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:51 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:18:51 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fce6ce-69b6-406c-b85f-a532ab5cd45b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:18:51 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5f8a77-3824-4976-9a97-93f68e5371b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842] added
Aug 15 21:18:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0de7e6c-7b73-4940-9215-003e60fb4e70]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5966a0-f4f8-4d1e-baf4-09288b7944eb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVMmpcse {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVMmpcse" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[64beeeab-ac29-4ad7-8cd7-b006c7e6498b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WVMmpcse'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[808627b8-6fb3-4837-bccf-8e8ae9e9525c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f764627-71cd-4749-8291-22c85e24d2fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[76145a5f-1785-4d3e-af66-74a46b0261fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]
Aug 15 21:18:51 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.
Aug 15 21:18:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8ee262-37ef-4a8a-ad44-68d0e628085c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[96576440-f7a9-4f5c-ba9c-1abd61f9f417]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:18:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] HCTL ('40', '-', '-', 0) found on session 20 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b6d094-d1f8-4381-b97b-62d47a7e2a1a]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Searching for a device in session 20 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:18:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23863393762633433', 'path': '/dev/sdi'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863393762633433', 'path': '/dev/sdi'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-507659784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-507659784',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC4t2+nmaAs27FyCYyguyqSgAe9CAMrpZ/FJByVORIFboOrEkCb/KaQS+ZLSH86GgIZAihoJRBzqLI7XWguwj13w4o9mOJJJMwvJ4f2DudJMu1wqjsl/OIXMlY+zBy31A==',key_name='tempest-keypair-1478025030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f14274f8917c464eb2583364aac4b207',ramdisk_id='',reservation_id='r-vd8xoz80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-717569970',owner_user_name='tempest-ServerActionsV293TestJSON-717569970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cebffa69e7640dabdeb9783896d23a6',uuid=7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converting VIF {"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.objects.instance [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:18:52 user nova-compute[72992]:   <uuid>7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c</uuid>
Aug 15 21:18:52 user nova-compute[72992]:   <name>instance-00000011</name>
Aug 15 21:18:52 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:18:52 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:18:52 user nova-compute[72992]:   <metadata>
Aug 15 21:18:52 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:18:52 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:18:52 user nova-compute[72992]:       <nova:name>tempest-ServerActionsV293TestJSON-server-507659784</nova:name>
Aug 15 21:18:52 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:18:51</nova:creationTime>
Aug 15 21:18:52 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:18:52 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:18:52 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:18:52 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:18:52 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:18:52 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:18:52 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:18:52 user nova-compute[72992]:       <nova:owner>
Aug 15 21:18:52 user nova-compute[72992]:         <nova:user uuid="5cebffa69e7640dabdeb9783896d23a6">tempest-ServerActionsV293TestJSON-717569970-project-member</nova:user>
Aug 15 21:18:52 user nova-compute[72992]:         <nova:project uuid="f14274f8917c464eb2583364aac4b207">tempest-ServerActionsV293TestJSON-717569970</nova:project>
Aug 15 21:18:52 user nova-compute[72992]:       </nova:owner>
Aug 15 21:18:52 user nova-compute[72992]:       <nova:ports>
Aug 15 21:18:52 user nova-compute[72992]:         <nova:port uuid="fc5d6d0d-096f-4934-afe8-b7e58667def8">
Aug 15 21:18:52 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:18:52 user nova-compute[72992]:         </nova:port>
Aug 15 21:18:52 user nova-compute[72992]:       </nova:ports>
Aug 15 21:18:52 user nova-compute[72992]:     </nova:instance>
Aug 15 21:18:52 user nova-compute[72992]:   </metadata>
Aug 15 21:18:52 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:18:52 user nova-compute[72992]:     <system>
Aug 15 21:18:52 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:18:52 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:18:52 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:18:52 user nova-compute[72992]:       <entry name="serial">7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c</entry>
Aug 15 21:18:52 user nova-compute[72992]:       <entry name="uuid">7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c</entry>
Aug 15 21:18:52 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:18:52 user nova-compute[72992]:     </system>
Aug 15 21:18:52 user nova-compute[72992]:   </sysinfo>
Aug 15 21:18:52 user nova-compute[72992]:   <os>
Aug 15 21:18:52 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:18:52 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:18:52 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:18:52 user nova-compute[72992]:   </os>
Aug 15 21:18:52 user nova-compute[72992]:   <features>
Aug 15 21:18:52 user nova-compute[72992]:     <acpi/>
Aug 15 21:18:52 user nova-compute[72992]:     <apic/>
Aug 15 21:18:52 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:18:52 user nova-compute[72992]:   </features>
Aug 15 21:18:52 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:18:52 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:18:52 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:18:52 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:18:52 user nova-compute[72992]:   </clock>
Aug 15 21:18:52 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:18:52 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:18:52 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:18:52 user nova-compute[72992]:   </cpu>
Aug 15 21:18:52 user nova-compute[72992]:   <devices>
Aug 15 21:18:52 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:18:52 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:18:52 user nova-compute[72992]:       <source dev="/dev/sdi"/>
Aug 15 21:18:52 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:18:52 user nova-compute[72992]:       <serial>cc30a2b7-9757-4c6c-96ed-f67a203c5842</serial>
Aug 15 21:18:52 user nova-compute[72992]:     </disk>
Aug 15 21:18:52 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:18:52 user nova-compute[72992]:       <mac address="fa:16:3e:98:e1:10"/>
Aug 15 21:18:52 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:52 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:18:52 user nova-compute[72992]:       <target dev="tapfc5d6d0d-09"/>
Aug 15 21:18:52 user nova-compute[72992]:     </interface>
Aug 15 21:18:52 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:18:52 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c/console.log" append="off"/>
Aug 15 21:18:52 user nova-compute[72992]:     </serial>
Aug 15 21:18:52 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:18:52 user nova-compute[72992]:     <video>
Aug 15 21:18:52 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:18:52 user nova-compute[72992]:     </video>
Aug 15 21:18:52 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:18:52 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:18:52 user nova-compute[72992]:     </rng>
Aug 15 21:18:52 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:18:52 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:18:52 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:18:52 user nova-compute[72992]:     </memballoon>
Aug 15 21:18:52 user nova-compute[72992]:   </devices>
Aug 15 21:18:52 user nova-compute[72992]: </domain>
Aug 15 21:18:52 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-507659784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-507659784',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC4t2+nmaAs27FyCYyguyqSgAe9CAMrpZ/FJByVORIFboOrEkCb/KaQS+ZLSH86GgIZAihoJRBzqLI7XWguwj13w4o9mOJJJMwvJ4f2DudJMu1wqjsl/OIXMlY+zBy31A==',key_name='tempest-keypair-1478025030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f14274f8917c464eb2583364aac4b207',ramdisk_id='',reservation_id='r-vd8xoz80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-717569970',owner_user_name='tempest-ServerActionsV293TestJSON-717569970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cebffa69e7640dabdeb9783896d23a6',uuid=7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converting VIF {"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG os_vif [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc5d6d0d-09, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc5d6d0d-09, col_values=(('external_ids', {'iface-id': 'fc5d6d0d-096f-4934-afe8-b7e58667def8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:e1:10', 'vm-uuid': '7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:52 user nova-compute[72992]: INFO os_vif [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09')
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:18:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] No VIF found with MAC fa:16:3e:98:e1:10, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bc85df4-b0d9-42b2-8b22-fdee64f12cd9 req-a8dfaf31-432c-46ac-bbf8-80e96467758b service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc85df4-b0d9-42b2-8b22-fdee64f12cd9 req-a8dfaf31-432c-46ac-bbf8-80e96467758b service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc85df4-b0d9-42b2-8b22-fdee64f12cd9 req-a8dfaf31-432c-46ac-bbf8-80e96467758b service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc85df4-b0d9-42b2-8b22-fdee64f12cd9 req-a8dfaf31-432c-46ac-bbf8-80e96467758b service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bc85df4-b0d9-42b2-8b22-fdee64f12cd9 req-a8dfaf31-432c-46ac-bbf8-80e96467758b service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No waiting events found dispatching network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:54 user nova-compute[72992]: WARNING nova.compute.manager [req-8bc85df4-b0d9-42b2-8b22-fdee64f12cd9 req-a8dfaf31-432c-46ac-bbf8-80e96467758b service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received unexpected event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with vm_state building and task_state spawning.
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134336.5866423, 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:56 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] VM Resumed (Lifecycle Event)
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:18:56 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance spawned successfully.
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:18:56 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134336.5947893, 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:18:56 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] VM Started (Lifecycle Event)
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:18:56 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:18:56 user nova-compute[72992]: INFO nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aa3f909-6256-413a-a8f8-3d9a172ce9e0 req-216ab0f2-75c2-4cae-9169-ad18fdcf01ae service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aa3f909-6256-413a-a8f8-3d9a172ce9e0 req-216ab0f2-75c2-4cae-9169-ad18fdcf01ae service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aa3f909-6256-413a-a8f8-3d9a172ce9e0 req-216ab0f2-75c2-4cae-9169-ad18fdcf01ae service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aa3f909-6256-413a-a8f8-3d9a172ce9e0 req-216ab0f2-75c2-4cae-9169-ad18fdcf01ae service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aa3f909-6256-413a-a8f8-3d9a172ce9e0 req-216ab0f2-75c2-4cae-9169-ad18fdcf01ae service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No waiting events found dispatching network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:18:56 user nova-compute[72992]: WARNING nova.compute.manager [req-2aa3f909-6256-413a-a8f8-3d9a172ce9e0 req-216ab0f2-75c2-4cae-9169-ad18fdcf01ae service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received unexpected event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with vm_state building and task_state spawning.
Aug 15 21:18:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:56 user nova-compute[72992]: INFO nova.compute.manager [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Took 19.61 seconds to build instance.
Aug 15 21:18:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-acdcae00-1c29-4fb8-a2ab-ab7d88ef3bea tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.709s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:18:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:18:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmYjpvis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:19:01 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:19:01 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:19:01 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d9abdc-7f74-4d3f-89cf-4000f310925c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:19:01 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ac96c2-b43b-4a78-b801-bdea3b635a24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606] added
Aug 15 21:19:01 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec8d2b-cd21-4164-b7fc-73e97cfb1a75]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dc74da-3914-4eb0-9f48-1c69481b47c7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmYjpvis {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmYjpvis" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cdaa1b-67a4-4e8d-a991-c4c75cc9fdf2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmYjpvis'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e08f7d-9200-44e6-a74d-df9ee30aa1c8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f5673-a68d-4dfb-a139-d7b97b82d866]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:01 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:01 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:01 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:01 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:01 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:01 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:01 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:01 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a3003-60ed-44bb-ae61-c3285e8817ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260]
Aug 15 21:19:02 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260] successful.
Aug 15 21:19:02 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41bbf3-64b5-44ed-a3bb-2809a0466932]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[465964d8-5c59-4435-bf86-7c695e6adcb9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 (non-flash)
Aug 15 21:19:02 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] HCTL ('41', '-', '-', 0) found on session 21 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0de0ae-ac7a-4c09-be60-1f98af9c7ae2]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Searching for a device in session 21 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmYjpvis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26236356339393230', 'path': '/dev/sdj'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236356339393230', 'path': '/dev/sdj'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'flavor' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:19:03 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:19:03 user nova-compute[72992]:   <source dev="/dev/sdj"/>
Aug 15 21:19:03 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:19:03 user nova-compute[72992]:   <serial>57e80471-975f-4e1c-a38b-116d494dd606</serial>
Aug 15 21:19:03 user nova-compute[72992]: </disk>
Aug 15 21:19:03 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No BDM found with device name hda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] No VIF found with MAC fa:16:3e:09:74:ea, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52c326e-9460-40ff-9da4-6424fb6b4ccb tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.242s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:05 user nova-compute[72992]: INFO nova.compute.manager [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Detaching volume 57e80471-975f-4e1c-a38b-116d494dd606
Aug 15 21:19:05 user nova-compute[72992]: INFO nova.virt.block_device [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Attempting to driver detach volume 57e80471-975f-4e1c-a38b-116d494dd606 from mountpoint /dev/vdb
Aug 15 21:19:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Attempting to detach device vdb from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:19:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:19:05 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:19:05 user nova-compute[72992]:   <source dev="/dev/sdj"/>
Aug 15 21:19:05 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:19:05 user nova-compute[72992]:   <serial>57e80471-975f-4e1c-a38b-116d494dd606</serial>
Aug 15 21:19:05 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 21:19:05 user nova-compute[72992]: </disk>
Aug 15 21:19:05 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully detached device vdb from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the persistent domain config.
Aug 15 21:19:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:19:06 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:19:06 user nova-compute[72992]:   <source dev="/dev/sdj"/>
Aug 15 21:19:06 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:19:06 user nova-compute[72992]:   <serial>57e80471-975f-4e1c-a38b-116d494dd606</serial>
Aug 15 21:19:06 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 21:19:06 user nova-compute[72992]: </disk>
Aug 15 21:19:06 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134346.4722724, ac18f6fd-751f-4a70-88b8-678eca326268 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully detached device vdb from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the live domain config.
Aug 15 21:19:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmYjpvis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:19:06 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac920277-6b37-4982-b2b8-6ec26644a54e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1cbf49-ca97-46ff-8a87-258daba6c9a1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 (non-flash)
Aug 15 21:19:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64ebbd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606'): ({'sdj'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Removing single pathed devices sdj {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07b425c-0942-4220-9a5f-bc0763698cac]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae2cfb-1f2b-4b79-b15e-3594a106681e]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Flushing IO for device /dev/sdj {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[af741e01-d4fc-4c3b-91a0-075bc3750801]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a5fc5-1c38-48a8-b5ee-520783e6e314]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] SCSI volumes sdj have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[620371a8-0f75-42e9-a83a-e0a036818aa6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8585095-78e9-4898-84a6-0a0ddf62104b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260]
Aug 15 21:19:06 user nova-compute[72992]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606, portal: 172.16.0.220,3260] successful.
Aug 15 21:19:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e80471-975f-4e1c-a38b-116d494dd606 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8612ad6-7efb-450c-bae0-f4ef61152587]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] <== disconnect_volume: return (376ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:19:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'flavor' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4cea531-f52a-4d95-bfcd-fb2e9cb4e5db tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.017s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "interface-ac18f6fd-751f-4a70-88b8-678eca326268-08493643-877c-4312-95bd-f98d4bc9fb21" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "interface-ac18f6fd-751f-4a70-88b8-678eca326268-08493643-877c-4312-95bd-f98d4bc9fb21" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'flavor' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converting VIF {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface> {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface> {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Attempting to detach device tap08493643-87 from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] detach device xml: <interface type="ethernet">
Aug 15 21:19:08 user nova-compute[72992]:   <mac address="fa:16:3e:12:29:46"/>
Aug 15 21:19:08 user nova-compute[72992]:   <model type="virtio"/>
Aug 15 21:19:08 user nova-compute[72992]:   <mtu size="1442"/>
Aug 15 21:19:08 user nova-compute[72992]:   <target dev="tap08493643-87"/>
Aug 15 21:19:08 user nova-compute[72992]: </interface>
Aug 15 21:19:08 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface> {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 21:19:08 user nova-compute[72992]:   <name>instance-0000000e</name>
Aug 15 21:19:08 user nova-compute[72992]:   <uuid>ac18f6fd-751f-4a70-88b8-678eca326268</uuid>
Aug 15 21:19:08 user nova-compute[72992]:   <metadata>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:08 user nova-compute[72992]:   <nova:package version="0.0.0"/>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:creationTime>2023-08-15 21:18:48</nova:creationTime>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:flavor name="m1.tiny">
Aug 15 21:19:08 user nova-compute[72992]:     <nova:memory>512</nova:memory>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:disk>1</nova:disk>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:swap>0</nova:swap>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:flavor>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:owner>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:owner>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:ports>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:19:08 user nova-compute[72992]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:19:08 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:port uuid="08493643-877c-4312-95bd-f98d4bc9fb21">
Aug 15 21:19:08 user nova-compute[72992]:       <nova:ip type="fixed" address="10.10.10.176" ipVersion="4"/>
Aug 15 21:19:08 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:ports>
Aug 15 21:19:08 user nova-compute[72992]: </nova:instance>
Aug 15 21:19:08 user nova-compute[72992]:   </metadata>
Aug 15 21:19:08 user nova-compute[72992]:   <memory unit='KiB'>524288</memory>
Aug 15 21:19:08 user nova-compute[72992]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 21:19:08 user nova-compute[72992]:   <vcpu placement='static'>1</vcpu>
Aug 15 21:19:08 user nova-compute[72992]:   <resource>
Aug 15 21:19:08 user nova-compute[72992]:     <partition>/machine</partition>
Aug 15 21:19:08 user nova-compute[72992]:   </resource>
Aug 15 21:19:08 user nova-compute[72992]:   <sysinfo type='smbios'>
Aug 15 21:19:08 user nova-compute[72992]:     <system>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='version'>0.0.0</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='serial'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='uuid'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='family'>Virtual Machine</entry>
Aug 15 21:19:08 user nova-compute[72992]:     </system>
Aug 15 21:19:08 user nova-compute[72992]:   </sysinfo>
Aug 15 21:19:08 user nova-compute[72992]:   <os>
Aug 15 21:19:08 user nova-compute[72992]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 21:19:08 user nova-compute[72992]:     <boot dev='hd'/>
Aug 15 21:19:08 user nova-compute[72992]:     <smbios mode='sysinfo'/>
Aug 15 21:19:08 user nova-compute[72992]:   </os>
Aug 15 21:19:08 user nova-compute[72992]:   <features>
Aug 15 21:19:08 user nova-compute[72992]:     <acpi/>
Aug 15 21:19:08 user nova-compute[72992]:     <apic/>
Aug 15 21:19:08 user nova-compute[72992]:     <vmcoreinfo state='on'/>
Aug 15 21:19:08 user nova-compute[72992]:   </features>
Aug 15 21:19:08 user nova-compute[72992]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 21:19:08 user nova-compute[72992]:     <model fallback='forbid'>Nehalem</model>
Aug 15 21:19:08 user nova-compute[72992]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 21:19:08 user nova-compute[72992]:     <feature policy='require' name='vme'/>
Aug 15 21:19:08 user nova-compute[72992]:     <feature policy='require' name='x2apic'/>
Aug 15 21:19:08 user nova-compute[72992]:     <feature policy='require' name='hypervisor'/>
Aug 15 21:19:08 user nova-compute[72992]:   </cpu>
Aug 15 21:19:08 user nova-compute[72992]:   <clock offset='utc'>
Aug 15 21:19:08 user nova-compute[72992]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 21:19:08 user nova-compute[72992]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 21:19:08 user nova-compute[72992]:     <timer name='hpet' present='no'/>
Aug 15 21:19:08 user nova-compute[72992]:   </clock>
Aug 15 21:19:08 user nova-compute[72992]:   <on_poweroff>destroy</on_poweroff>
Aug 15 21:19:08 user nova-compute[72992]:   <on_reboot>restart</on_reboot>
Aug 15 21:19:08 user nova-compute[72992]:   <on_crash>destroy</on_crash>
Aug 15 21:19:08 user nova-compute[72992]:   <devices>
Aug 15 21:19:08 user nova-compute[72992]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 21:19:08 user nova-compute[72992]:     <disk type='file' device='disk'>
Aug 15 21:19:08 user nova-compute[72992]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 21:19:08 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk' index='2'/>
Aug 15 21:19:08 user nova-compute[72992]:       <backingStore type='file' index='3'>
Aug 15 21:19:08 user nova-compute[72992]:         <format type='raw'/>
Aug 15 21:19:08 user nova-compute[72992]:         <source file='/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d'/>
Aug 15 21:19:08 user nova-compute[72992]:         <backingStore/>
Aug 15 21:19:08 user nova-compute[72992]:       </backingStore>
Aug 15 21:19:08 user nova-compute[72992]:       <target dev='vda' bus='virtio'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='virtio-disk0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </disk>
Aug 15 21:19:08 user nova-compute[72992]:     <disk type='file' device='cdrom'>
Aug 15 21:19:08 user nova-compute[72992]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 21:19:08 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config' index='1'/>
Aug 15 21:19:08 user nova-compute[72992]:       <backingStore/>
Aug 15 21:19:08 user nova-compute[72992]:       <target dev='hda' bus='ide'/>
Aug 15 21:19:08 user nova-compute[72992]:       <readonly/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='ide0-0-0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </disk>
Aug 15 21:19:08 user nova-compute[72992]:     <controller type='usb' index='0' model='none'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='usb'/>
Aug 15 21:19:08 user nova-compute[72992]:     </controller>
Aug 15 21:19:08 user nova-compute[72992]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='pci.0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </controller>
Aug 15 21:19:08 user nova-compute[72992]:     <controller type='ide' index='0'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='ide'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 21:19:08 user nova-compute[72992]:     </controller>
Aug 15 21:19:08 user nova-compute[72992]:     <interface type='ethernet'>
Aug 15 21:19:08 user nova-compute[72992]:       <mac address='fa:16:3e:09:74:ea'/>
Aug 15 21:19:08 user nova-compute[72992]:       <target dev='tapc7f27105-87'/>
Aug 15 21:19:08 user nova-compute[72992]:       <model type='virtio'/>
Aug 15 21:19:08 user nova-compute[72992]:       <mtu size='1442'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='net0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </interface>
Aug 15 21:19:08 user nova-compute[72992]:     <interface type='ethernet'>
Aug 15 21:19:08 user nova-compute[72992]:       <mac address='fa:16:3e:12:29:46'/>
Aug 15 21:19:08 user nova-compute[72992]:       <target dev='tap08493643-87'/>
Aug 15 21:19:08 user nova-compute[72992]:       <model type='virtio'/>
Aug 15 21:19:08 user nova-compute[72992]:       <mtu size='1442'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='net1'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </interface>
Aug 15 21:19:08 user nova-compute[72992]:     <serial type='pty'>
Aug 15 21:19:08 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:08 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:08 user nova-compute[72992]:       <target type='isa-serial' port='0'>
Aug 15 21:19:08 user nova-compute[72992]:         <model name='isa-serial'/>
Aug 15 21:19:08 user nova-compute[72992]:       </target>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </serial>
Aug 15 21:19:08 user nova-compute[72992]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 21:19:08 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:08 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:08 user nova-compute[72992]:       <target type='serial' port='0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </console>
Aug 15 21:19:08 user nova-compute[72992]:     <input type='mouse' bus='ps2'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='input0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </input>
Aug 15 21:19:08 user nova-compute[72992]:     <input type='keyboard' bus='ps2'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='input1'/>
Aug 15 21:19:08 user nova-compute[72992]:     </input>
Aug 15 21:19:08 user nova-compute[72992]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 21:19:08 user nova-compute[72992]:       <listen type='address' address='0.0.0.0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </graphics>
Aug 15 21:19:08 user nova-compute[72992]:     <audio id='1' type='none'/>
Aug 15 21:19:08 user nova-compute[72992]:     <video>
Aug 15 21:19:08 user nova-compute[72992]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='video0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </video>
Aug 15 21:19:08 user nova-compute[72992]:     <memballoon model='virtio'>
Aug 15 21:19:08 user nova-compute[72992]:       <stats period='10'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='balloon0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </memballoon>
Aug 15 21:19:08 user nova-compute[72992]:     <rng model='virtio'>
Aug 15 21:19:08 user nova-compute[72992]:       <backend model='random'>/dev/urandom</backend>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='rng0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </rng>
Aug 15 21:19:08 user nova-compute[72992]:   </devices>
Aug 15 21:19:08 user nova-compute[72992]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 21:19:08 user nova-compute[72992]:     <label>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</label>
Aug 15 21:19:08 user nova-compute[72992]:     <imagelabel>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</imagelabel>
Aug 15 21:19:08 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:08 user nova-compute[72992]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 21:19:08 user nova-compute[72992]:     <label>+64055:+108</label>
Aug 15 21:19:08 user nova-compute[72992]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 21:19:08 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:08 user nova-compute[72992]: </domain>
Aug 15 21:19:08 user nova-compute[72992]:  {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 21:19:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully detached device tap08493643-87 from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the persistent domain config.
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] (1/8): Attempting to detach device tap08493643-87 with device alias net1 from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] detach device xml: <interface type="ethernet">
Aug 15 21:19:08 user nova-compute[72992]:   <mac address="fa:16:3e:12:29:46"/>
Aug 15 21:19:08 user nova-compute[72992]:   <model type="virtio"/>
Aug 15 21:19:08 user nova-compute[72992]:   <mtu size="1442"/>
Aug 15 21:19:08 user nova-compute[72992]:   <target dev="tap08493643-87"/>
Aug 15 21:19:08 user nova-compute[72992]: </interface>
Aug 15 21:19:08 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134348.5369232, ac18f6fd-751f-4a70-88b8-678eca326268 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Start waiting for the detach event from libvirt for device tap08493643-87 with device alias net1 for instance ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface> {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 21:19:08 user nova-compute[72992]:   <name>instance-0000000e</name>
Aug 15 21:19:08 user nova-compute[72992]:   <uuid>ac18f6fd-751f-4a70-88b8-678eca326268</uuid>
Aug 15 21:19:08 user nova-compute[72992]:   <metadata>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:08 user nova-compute[72992]:   <nova:package version="0.0.0"/>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:creationTime>2023-08-15 21:18:48</nova:creationTime>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:flavor name="m1.tiny">
Aug 15 21:19:08 user nova-compute[72992]:     <nova:memory>512</nova:memory>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:disk>1</nova:disk>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:swap>0</nova:swap>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:flavor>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:owner>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:owner>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:ports>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:19:08 user nova-compute[72992]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:19:08 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:port uuid="08493643-877c-4312-95bd-f98d4bc9fb21">
Aug 15 21:19:08 user nova-compute[72992]:       <nova:ip type="fixed" address="10.10.10.176" ipVersion="4"/>
Aug 15 21:19:08 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:ports>
Aug 15 21:19:08 user nova-compute[72992]: </nova:instance>
Aug 15 21:19:08 user nova-compute[72992]:   </metadata>
Aug 15 21:19:08 user nova-compute[72992]:   <memory unit='KiB'>524288</memory>
Aug 15 21:19:08 user nova-compute[72992]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 21:19:08 user nova-compute[72992]:   <vcpu placement='static'>1</vcpu>
Aug 15 21:19:08 user nova-compute[72992]:   <resource>
Aug 15 21:19:08 user nova-compute[72992]:     <partition>/machine</partition>
Aug 15 21:19:08 user nova-compute[72992]:   </resource>
Aug 15 21:19:08 user nova-compute[72992]:   <sysinfo type='smbios'>
Aug 15 21:19:08 user nova-compute[72992]:     <system>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='version'>0.0.0</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='serial'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='uuid'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:08 user nova-compute[72992]:       <entry name='family'>Virtual Machine</entry>
Aug 15 21:19:08 user nova-compute[72992]:     </system>
Aug 15 21:19:08 user nova-compute[72992]:   </sysinfo>
Aug 15 21:19:08 user nova-compute[72992]:   <os>
Aug 15 21:19:08 user nova-compute[72992]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 21:19:08 user nova-compute[72992]:     <boot dev='hd'/>
Aug 15 21:19:08 user nova-compute[72992]:     <smbios mode='sysinfo'/>
Aug 15 21:19:08 user nova-compute[72992]:   </os>
Aug 15 21:19:08 user nova-compute[72992]:   <features>
Aug 15 21:19:08 user nova-compute[72992]:     <acpi/>
Aug 15 21:19:08 user nova-compute[72992]:     <apic/>
Aug 15 21:19:08 user nova-compute[72992]:     <vmcoreinfo state='on'/>
Aug 15 21:19:08 user nova-compute[72992]:   </features>
Aug 15 21:19:08 user nova-compute[72992]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 21:19:08 user nova-compute[72992]:     <model fallback='forbid'>Nehalem</model>
Aug 15 21:19:08 user nova-compute[72992]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 21:19:08 user nova-compute[72992]:     <feature policy='require' name='vme'/>
Aug 15 21:19:08 user nova-compute[72992]:     <feature policy='require' name='x2apic'/>
Aug 15 21:19:08 user nova-compute[72992]:     <feature policy='require' name='hypervisor'/>
Aug 15 21:19:08 user nova-compute[72992]:   </cpu>
Aug 15 21:19:08 user nova-compute[72992]:   <clock offset='utc'>
Aug 15 21:19:08 user nova-compute[72992]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 21:19:08 user nova-compute[72992]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 21:19:08 user nova-compute[72992]:     <timer name='hpet' present='no'/>
Aug 15 21:19:08 user nova-compute[72992]:   </clock>
Aug 15 21:19:08 user nova-compute[72992]:   <on_poweroff>destroy</on_poweroff>
Aug 15 21:19:08 user nova-compute[72992]:   <on_reboot>restart</on_reboot>
Aug 15 21:19:08 user nova-compute[72992]:   <on_crash>destroy</on_crash>
Aug 15 21:19:08 user nova-compute[72992]:   <devices>
Aug 15 21:19:08 user nova-compute[72992]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 21:19:08 user nova-compute[72992]:     <disk type='file' device='disk'>
Aug 15 21:19:08 user nova-compute[72992]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 21:19:08 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk' index='2'/>
Aug 15 21:19:08 user nova-compute[72992]:       <backingStore type='file' index='3'>
Aug 15 21:19:08 user nova-compute[72992]:         <format type='raw'/>
Aug 15 21:19:08 user nova-compute[72992]:         <source file='/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d'/>
Aug 15 21:19:08 user nova-compute[72992]:         <backingStore/>
Aug 15 21:19:08 user nova-compute[72992]:       </backingStore>
Aug 15 21:19:08 user nova-compute[72992]:       <target dev='vda' bus='virtio'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='virtio-disk0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </disk>
Aug 15 21:19:08 user nova-compute[72992]:     <disk type='file' device='cdrom'>
Aug 15 21:19:08 user nova-compute[72992]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 21:19:08 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config' index='1'/>
Aug 15 21:19:08 user nova-compute[72992]:       <backingStore/>
Aug 15 21:19:08 user nova-compute[72992]:       <target dev='hda' bus='ide'/>
Aug 15 21:19:08 user nova-compute[72992]:       <readonly/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='ide0-0-0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </disk>
Aug 15 21:19:08 user nova-compute[72992]:     <controller type='usb' index='0' model='none'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='usb'/>
Aug 15 21:19:08 user nova-compute[72992]:     </controller>
Aug 15 21:19:08 user nova-compute[72992]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='pci.0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </controller>
Aug 15 21:19:08 user nova-compute[72992]:     <controller type='ide' index='0'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='ide'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 21:19:08 user nova-compute[72992]:     </controller>
Aug 15 21:19:08 user nova-compute[72992]:     <interface type='ethernet'>
Aug 15 21:19:08 user nova-compute[72992]:       <mac address='fa:16:3e:09:74:ea'/>
Aug 15 21:19:08 user nova-compute[72992]:       <target dev='tapc7f27105-87'/>
Aug 15 21:19:08 user nova-compute[72992]:       <model type='virtio'/>
Aug 15 21:19:08 user nova-compute[72992]:       <mtu size='1442'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='net0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </interface>
Aug 15 21:19:08 user nova-compute[72992]:     <serial type='pty'>
Aug 15 21:19:08 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:08 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:08 user nova-compute[72992]:       <target type='isa-serial' port='0'>
Aug 15 21:19:08 user nova-compute[72992]:         <model name='isa-serial'/>
Aug 15 21:19:08 user nova-compute[72992]:       </target>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </serial>
Aug 15 21:19:08 user nova-compute[72992]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 21:19:08 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:08 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:08 user nova-compute[72992]:       <target type='serial' port='0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </console>
Aug 15 21:19:08 user nova-compute[72992]:     <input type='mouse' bus='ps2'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='input0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </input>
Aug 15 21:19:08 user nova-compute[72992]:     <input type='keyboard' bus='ps2'>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='input1'/>
Aug 15 21:19:08 user nova-compute[72992]:     </input>
Aug 15 21:19:08 user nova-compute[72992]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 21:19:08 user nova-compute[72992]:       <listen type='address' address='0.0.0.0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </graphics>
Aug 15 21:19:08 user nova-compute[72992]:     <audio id='1' type='none'/>
Aug 15 21:19:08 user nova-compute[72992]:     <video>
Aug 15 21:19:08 user nova-compute[72992]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='video0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </video>
Aug 15 21:19:08 user nova-compute[72992]:     <memballoon model='virtio'>
Aug 15 21:19:08 user nova-compute[72992]:       <stats period='10'/>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='balloon0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </memballoon>
Aug 15 21:19:08 user nova-compute[72992]:     <rng model='virtio'>
Aug 15 21:19:08 user nova-compute[72992]:       <backend model='random'>/dev/urandom</backend>
Aug 15 21:19:08 user nova-compute[72992]:       <alias name='rng0'/>
Aug 15 21:19:08 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 21:19:08 user nova-compute[72992]:     </rng>
Aug 15 21:19:08 user nova-compute[72992]:   </devices>
Aug 15 21:19:08 user nova-compute[72992]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 21:19:08 user nova-compute[72992]:     <label>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</label>
Aug 15 21:19:08 user nova-compute[72992]:     <imagelabel>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</imagelabel>
Aug 15 21:19:08 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:08 user nova-compute[72992]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 21:19:08 user nova-compute[72992]:     <label>+64055:+108</label>
Aug 15 21:19:08 user nova-compute[72992]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 21:19:08 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:08 user nova-compute[72992]: </domain>
Aug 15 21:19:08 user nova-compute[72992]:  {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 21:19:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully detached device tap08493643-87 from instance ac18f6fd-751f-4a70-88b8-678eca326268 from the live domain config.
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converting VIF {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG os_vif [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08493643-87, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:08 user nova-compute[72992]: INFO os_vif [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87')
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:08 user nova-compute[72992]:   <nova:package version="0.0.0"/>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:creationTime>2023-08-15 21:19:08</nova:creationTime>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:flavor name="m1.tiny">
Aug 15 21:19:08 user nova-compute[72992]:     <nova:memory>512</nova:memory>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:disk>1</nova:disk>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:swap>0</nova:swap>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:flavor>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:owner>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:owner>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:08 user nova-compute[72992]:   <nova:ports>
Aug 15 21:19:08 user nova-compute[72992]:     <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:19:08 user nova-compute[72992]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:19:08 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:08 user nova-compute[72992]:   </nova:ports>
Aug 15 21:19:08 user nova-compute[72992]: </nova:instance>
Aug 15 21:19:08 user nova-compute[72992]:  {{(pid=72992) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:19:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7027MB free_disk=25.52751922607422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:09 user nova-compute[72992]: INFO nova.compute.manager [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Unrescuing
Aug 15 21:19:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 412a57dc-d6a0-44ec-a661-05fed5309955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance ac18f6fd-751f-4a70-88b8-678eca326268 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5b5143db-39e5-4962-a85d-fe6cd0cdb45d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 9ee81390-8064-4a06-893e-d5238e4b06bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:19:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-deleted-08493643-877c-4312-95bd-f98d4bc9fb21 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:10 user nova-compute[72992]: INFO nova.compute.manager [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Neutron deleted interface 08493643-877c-4312-95bd-f98d4bc9fb21; detaching it from the instance and deleting it from the info cache
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.network.neutron [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquired lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.objects.instance [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Lazy-loading 'system_metadata' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.objects.instance [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Lazy-loading 'flavor' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.network.os_vif_util [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Converting VIF {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.network.os_vif_util [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface> {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 21:19:10 user nova-compute[72992]:   <name>instance-0000000e</name>
Aug 15 21:19:10 user nova-compute[72992]:   <uuid>ac18f6fd-751f-4a70-88b8-678eca326268</uuid>
Aug 15 21:19:10 user nova-compute[72992]:   <metadata>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:10 user nova-compute[72992]:   <nova:package version="0.0.0"/>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:creationTime>2023-08-15 21:19:08</nova:creationTime>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:flavor name="m1.tiny">
Aug 15 21:19:10 user nova-compute[72992]:     <nova:memory>512</nova:memory>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:disk>1</nova:disk>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:swap>0</nova:swap>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:flavor>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:owner>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:owner>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:ports>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:19:10 user nova-compute[72992]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:19:10 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:ports>
Aug 15 21:19:10 user nova-compute[72992]: </nova:instance>
Aug 15 21:19:10 user nova-compute[72992]:   </metadata>
Aug 15 21:19:10 user nova-compute[72992]:   <memory unit='KiB'>524288</memory>
Aug 15 21:19:10 user nova-compute[72992]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 21:19:10 user nova-compute[72992]:   <vcpu placement='static'>1</vcpu>
Aug 15 21:19:10 user nova-compute[72992]:   <resource>
Aug 15 21:19:10 user nova-compute[72992]:     <partition>/machine</partition>
Aug 15 21:19:10 user nova-compute[72992]:   </resource>
Aug 15 21:19:10 user nova-compute[72992]:   <sysinfo type='smbios'>
Aug 15 21:19:10 user nova-compute[72992]:     <system>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='version'>0.0.0</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='serial'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='uuid'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='family'>Virtual Machine</entry>
Aug 15 21:19:10 user nova-compute[72992]:     </system>
Aug 15 21:19:10 user nova-compute[72992]:   </sysinfo>
Aug 15 21:19:10 user nova-compute[72992]:   <os>
Aug 15 21:19:10 user nova-compute[72992]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 21:19:10 user nova-compute[72992]:     <boot dev='hd'/>
Aug 15 21:19:10 user nova-compute[72992]:     <smbios mode='sysinfo'/>
Aug 15 21:19:10 user nova-compute[72992]:   </os>
Aug 15 21:19:10 user nova-compute[72992]:   <features>
Aug 15 21:19:10 user nova-compute[72992]:     <acpi/>
Aug 15 21:19:10 user nova-compute[72992]:     <apic/>
Aug 15 21:19:10 user nova-compute[72992]:     <vmcoreinfo state='on'/>
Aug 15 21:19:10 user nova-compute[72992]:   </features>
Aug 15 21:19:10 user nova-compute[72992]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 21:19:10 user nova-compute[72992]:     <model fallback='forbid'>Nehalem</model>
Aug 15 21:19:10 user nova-compute[72992]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 21:19:10 user nova-compute[72992]:     <feature policy='require' name='vme'/>
Aug 15 21:19:10 user nova-compute[72992]:     <feature policy='require' name='x2apic'/>
Aug 15 21:19:10 user nova-compute[72992]:     <feature policy='require' name='hypervisor'/>
Aug 15 21:19:10 user nova-compute[72992]:   </cpu>
Aug 15 21:19:10 user nova-compute[72992]:   <clock offset='utc'>
Aug 15 21:19:10 user nova-compute[72992]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 21:19:10 user nova-compute[72992]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 21:19:10 user nova-compute[72992]:     <timer name='hpet' present='no'/>
Aug 15 21:19:10 user nova-compute[72992]:   </clock>
Aug 15 21:19:10 user nova-compute[72992]:   <on_poweroff>destroy</on_poweroff>
Aug 15 21:19:10 user nova-compute[72992]:   <on_reboot>restart</on_reboot>
Aug 15 21:19:10 user nova-compute[72992]:   <on_crash>destroy</on_crash>
Aug 15 21:19:10 user nova-compute[72992]:   <devices>
Aug 15 21:19:10 user nova-compute[72992]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 21:19:10 user nova-compute[72992]:     <disk type='file' device='disk'>
Aug 15 21:19:10 user nova-compute[72992]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 21:19:10 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk' index='2'/>
Aug 15 21:19:10 user nova-compute[72992]:       <backingStore type='file' index='3'>
Aug 15 21:19:10 user nova-compute[72992]:         <format type='raw'/>
Aug 15 21:19:10 user nova-compute[72992]:         <source file='/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d'/>
Aug 15 21:19:10 user nova-compute[72992]:         <backingStore/>
Aug 15 21:19:10 user nova-compute[72992]:       </backingStore>
Aug 15 21:19:10 user nova-compute[72992]:       <target dev='vda' bus='virtio'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='virtio-disk0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </disk>
Aug 15 21:19:10 user nova-compute[72992]:     <disk type='file' device='cdrom'>
Aug 15 21:19:10 user nova-compute[72992]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 21:19:10 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config' index='1'/>
Aug 15 21:19:10 user nova-compute[72992]:       <backingStore/>
Aug 15 21:19:10 user nova-compute[72992]:       <target dev='hda' bus='ide'/>
Aug 15 21:19:10 user nova-compute[72992]:       <readonly/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='ide0-0-0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </disk>
Aug 15 21:19:10 user nova-compute[72992]:     <controller type='usb' index='0' model='none'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='usb'/>
Aug 15 21:19:10 user nova-compute[72992]:     </controller>
Aug 15 21:19:10 user nova-compute[72992]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='pci.0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </controller>
Aug 15 21:19:10 user nova-compute[72992]:     <controller type='ide' index='0'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='ide'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 21:19:10 user nova-compute[72992]:     </controller>
Aug 15 21:19:10 user nova-compute[72992]:     <interface type='ethernet'>
Aug 15 21:19:10 user nova-compute[72992]:       <mac address='fa:16:3e:09:74:ea'/>
Aug 15 21:19:10 user nova-compute[72992]:       <target dev='tapc7f27105-87'/>
Aug 15 21:19:10 user nova-compute[72992]:       <model type='virtio'/>
Aug 15 21:19:10 user nova-compute[72992]:       <mtu size='1442'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='net0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </interface>
Aug 15 21:19:10 user nova-compute[72992]:     <serial type='pty'>
Aug 15 21:19:10 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:10 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:10 user nova-compute[72992]:       <target type='isa-serial' port='0'>
Aug 15 21:19:10 user nova-compute[72992]:         <model name='isa-serial'/>
Aug 15 21:19:10 user nova-compute[72992]:       </target>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </serial>
Aug 15 21:19:10 user nova-compute[72992]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 21:19:10 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:10 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:10 user nova-compute[72992]:       <target type='serial' port='0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </console>
Aug 15 21:19:10 user nova-compute[72992]:     <input type='mouse' bus='ps2'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='input0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </input>
Aug 15 21:19:10 user nova-compute[72992]:     <input type='keyboard' bus='ps2'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='input1'/>
Aug 15 21:19:10 user nova-compute[72992]:     </input>
Aug 15 21:19:10 user nova-compute[72992]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 21:19:10 user nova-compute[72992]:       <listen type='address' address='0.0.0.0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </graphics>
Aug 15 21:19:10 user nova-compute[72992]:     <audio id='1' type='none'/>
Aug 15 21:19:10 user nova-compute[72992]:     <video>
Aug 15 21:19:10 user nova-compute[72992]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='video0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </video>
Aug 15 21:19:10 user nova-compute[72992]:     <memballoon model='virtio'>
Aug 15 21:19:10 user nova-compute[72992]:       <stats period='10'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='balloon0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </memballoon>
Aug 15 21:19:10 user nova-compute[72992]:     <rng model='virtio'>
Aug 15 21:19:10 user nova-compute[72992]:       <backend model='random'>/dev/urandom</backend>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='rng0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </rng>
Aug 15 21:19:10 user nova-compute[72992]:   </devices>
Aug 15 21:19:10 user nova-compute[72992]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 21:19:10 user nova-compute[72992]:     <label>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</label>
Aug 15 21:19:10 user nova-compute[72992]:     <imagelabel>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</imagelabel>
Aug 15 21:19:10 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:10 user nova-compute[72992]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 21:19:10 user nova-compute[72992]:     <label>+64055:+108</label>
Aug 15 21:19:10 user nova-compute[72992]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 21:19:10 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:10 user nova-compute[72992]: </domain>
Aug 15 21:19:10 user nova-compute[72992]:  {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface> {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:12:29:46"/><model type="virtio"/><mtu size="1442"/><target dev="tap08493643-87"/></interface>not found in domain: <domain type='kvm' id='15'>
Aug 15 21:19:10 user nova-compute[72992]:   <name>instance-0000000e</name>
Aug 15 21:19:10 user nova-compute[72992]:   <uuid>ac18f6fd-751f-4a70-88b8-678eca326268</uuid>
Aug 15 21:19:10 user nova-compute[72992]:   <metadata>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:10 user nova-compute[72992]:   <nova:package version="0.0.0"/>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:creationTime>2023-08-15 21:19:08</nova:creationTime>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:flavor name="m1.tiny">
Aug 15 21:19:10 user nova-compute[72992]:     <nova:memory>512</nova:memory>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:disk>1</nova:disk>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:swap>0</nova:swap>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:flavor>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:owner>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:owner>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:ports>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:19:10 user nova-compute[72992]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:19:10 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:ports>
Aug 15 21:19:10 user nova-compute[72992]: </nova:instance>
Aug 15 21:19:10 user nova-compute[72992]:   </metadata>
Aug 15 21:19:10 user nova-compute[72992]:   <memory unit='KiB'>524288</memory>
Aug 15 21:19:10 user nova-compute[72992]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 21:19:10 user nova-compute[72992]:   <vcpu placement='static'>1</vcpu>
Aug 15 21:19:10 user nova-compute[72992]:   <resource>
Aug 15 21:19:10 user nova-compute[72992]:     <partition>/machine</partition>
Aug 15 21:19:10 user nova-compute[72992]:   </resource>
Aug 15 21:19:10 user nova-compute[72992]:   <sysinfo type='smbios'>
Aug 15 21:19:10 user nova-compute[72992]:     <system>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='version'>0.0.0</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='serial'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='uuid'>ac18f6fd-751f-4a70-88b8-678eca326268</entry>
Aug 15 21:19:10 user nova-compute[72992]:       <entry name='family'>Virtual Machine</entry>
Aug 15 21:19:10 user nova-compute[72992]:     </system>
Aug 15 21:19:10 user nova-compute[72992]:   </sysinfo>
Aug 15 21:19:10 user nova-compute[72992]:   <os>
Aug 15 21:19:10 user nova-compute[72992]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 21:19:10 user nova-compute[72992]:     <boot dev='hd'/>
Aug 15 21:19:10 user nova-compute[72992]:     <smbios mode='sysinfo'/>
Aug 15 21:19:10 user nova-compute[72992]:   </os>
Aug 15 21:19:10 user nova-compute[72992]:   <features>
Aug 15 21:19:10 user nova-compute[72992]:     <acpi/>
Aug 15 21:19:10 user nova-compute[72992]:     <apic/>
Aug 15 21:19:10 user nova-compute[72992]:     <vmcoreinfo state='on'/>
Aug 15 21:19:10 user nova-compute[72992]:   </features>
Aug 15 21:19:10 user nova-compute[72992]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 21:19:10 user nova-compute[72992]:     <model fallback='forbid'>Nehalem</model>
Aug 15 21:19:10 user nova-compute[72992]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 21:19:10 user nova-compute[72992]:     <feature policy='require' name='vme'/>
Aug 15 21:19:10 user nova-compute[72992]:     <feature policy='require' name='x2apic'/>
Aug 15 21:19:10 user nova-compute[72992]:     <feature policy='require' name='hypervisor'/>
Aug 15 21:19:10 user nova-compute[72992]:   </cpu>
Aug 15 21:19:10 user nova-compute[72992]:   <clock offset='utc'>
Aug 15 21:19:10 user nova-compute[72992]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 21:19:10 user nova-compute[72992]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 21:19:10 user nova-compute[72992]:     <timer name='hpet' present='no'/>
Aug 15 21:19:10 user nova-compute[72992]:   </clock>
Aug 15 21:19:10 user nova-compute[72992]:   <on_poweroff>destroy</on_poweroff>
Aug 15 21:19:10 user nova-compute[72992]:   <on_reboot>restart</on_reboot>
Aug 15 21:19:10 user nova-compute[72992]:   <on_crash>destroy</on_crash>
Aug 15 21:19:10 user nova-compute[72992]:   <devices>
Aug 15 21:19:10 user nova-compute[72992]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 21:19:10 user nova-compute[72992]:     <disk type='file' device='disk'>
Aug 15 21:19:10 user nova-compute[72992]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 21:19:10 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk' index='2'/>
Aug 15 21:19:10 user nova-compute[72992]:       <backingStore type='file' index='3'>
Aug 15 21:19:10 user nova-compute[72992]:         <format type='raw'/>
Aug 15 21:19:10 user nova-compute[72992]:         <source file='/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d'/>
Aug 15 21:19:10 user nova-compute[72992]:         <backingStore/>
Aug 15 21:19:10 user nova-compute[72992]:       </backingStore>
Aug 15 21:19:10 user nova-compute[72992]:       <target dev='vda' bus='virtio'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='virtio-disk0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </disk>
Aug 15 21:19:10 user nova-compute[72992]:     <disk type='file' device='cdrom'>
Aug 15 21:19:10 user nova-compute[72992]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 21:19:10 user nova-compute[72992]:       <source file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/disk.config' index='1'/>
Aug 15 21:19:10 user nova-compute[72992]:       <backingStore/>
Aug 15 21:19:10 user nova-compute[72992]:       <target dev='hda' bus='ide'/>
Aug 15 21:19:10 user nova-compute[72992]:       <readonly/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='ide0-0-0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </disk>
Aug 15 21:19:10 user nova-compute[72992]:     <controller type='usb' index='0' model='none'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='usb'/>
Aug 15 21:19:10 user nova-compute[72992]:     </controller>
Aug 15 21:19:10 user nova-compute[72992]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='pci.0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </controller>
Aug 15 21:19:10 user nova-compute[72992]:     <controller type='ide' index='0'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='ide'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 21:19:10 user nova-compute[72992]:     </controller>
Aug 15 21:19:10 user nova-compute[72992]:     <interface type='ethernet'>
Aug 15 21:19:10 user nova-compute[72992]:       <mac address='fa:16:3e:09:74:ea'/>
Aug 15 21:19:10 user nova-compute[72992]:       <target dev='tapc7f27105-87'/>
Aug 15 21:19:10 user nova-compute[72992]:       <model type='virtio'/>
Aug 15 21:19:10 user nova-compute[72992]:       <mtu size='1442'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='net0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </interface>
Aug 15 21:19:10 user nova-compute[72992]:     <serial type='pty'>
Aug 15 21:19:10 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:10 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:10 user nova-compute[72992]:       <target type='isa-serial' port='0'>
Aug 15 21:19:10 user nova-compute[72992]:         <model name='isa-serial'/>
Aug 15 21:19:10 user nova-compute[72992]:       </target>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </serial>
Aug 15 21:19:10 user nova-compute[72992]:     <console type='pty' tty='/dev/pts/7'>
Aug 15 21:19:10 user nova-compute[72992]:       <source path='/dev/pts/7'/>
Aug 15 21:19:10 user nova-compute[72992]:       <log file='/opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268/console.log' append='off'/>
Aug 15 21:19:10 user nova-compute[72992]:       <target type='serial' port='0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='serial0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </console>
Aug 15 21:19:10 user nova-compute[72992]:     <input type='mouse' bus='ps2'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='input0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </input>
Aug 15 21:19:10 user nova-compute[72992]:     <input type='keyboard' bus='ps2'>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='input1'/>
Aug 15 21:19:10 user nova-compute[72992]:     </input>
Aug 15 21:19:10 user nova-compute[72992]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 15 21:19:10 user nova-compute[72992]:       <listen type='address' address='0.0.0.0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </graphics>
Aug 15 21:19:10 user nova-compute[72992]:     <audio id='1' type='none'/>
Aug 15 21:19:10 user nova-compute[72992]:     <video>
Aug 15 21:19:10 user nova-compute[72992]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='video0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </video>
Aug 15 21:19:10 user nova-compute[72992]:     <memballoon model='virtio'>
Aug 15 21:19:10 user nova-compute[72992]:       <stats period='10'/>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='balloon0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </memballoon>
Aug 15 21:19:10 user nova-compute[72992]:     <rng model='virtio'>
Aug 15 21:19:10 user nova-compute[72992]:       <backend model='random'>/dev/urandom</backend>
Aug 15 21:19:10 user nova-compute[72992]:       <alias name='rng0'/>
Aug 15 21:19:10 user nova-compute[72992]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 21:19:10 user nova-compute[72992]:     </rng>
Aug 15 21:19:10 user nova-compute[72992]:   </devices>
Aug 15 21:19:10 user nova-compute[72992]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 21:19:10 user nova-compute[72992]:     <label>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</label>
Aug 15 21:19:10 user nova-compute[72992]:     <imagelabel>libvirt-ac18f6fd-751f-4a70-88b8-678eca326268</imagelabel>
Aug 15 21:19:10 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:10 user nova-compute[72992]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 21:19:10 user nova-compute[72992]:     <label>+64055:+108</label>
Aug 15 21:19:10 user nova-compute[72992]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 21:19:10 user nova-compute[72992]:   </seclabel>
Aug 15 21:19:10 user nova-compute[72992]: </domain>
Aug 15 21:19:10 user nova-compute[72992]:  {{(pid=72992) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 21:19:10 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Detaching interface fa:16:3e:12:29:46 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap08493643-87' not found.
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.network.os_vif_util [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Converting VIF {"id": "08493643-877c-4312-95bd-f98d4bc9fb21", "address": "fa:16:3e:12:29:46", "network": {"id": "9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1422194179", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08493643-87", "ovs_interfaceid": "08493643-877c-4312-95bd-f98d4bc9fb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.network.os_vif_util [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG os_vif [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08493643-87, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:19:10 user nova-compute[72992]: INFO os_vif [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:29:46,bridge_name='br-int',has_traffic_filtering=True,id=08493643-877c-4312-95bd-f98d4bc9fb21,network=Network(9c0948fe-4800-4f0a-9ea9-ef06fcd5aff2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08493643-87')
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [req-8d305202-30f3-4e57-b772-2efae46fbb45 req-205b5132-6865-4cb2-8456-7c041c4e96da service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:10 user nova-compute[72992]:   <nova:package version="0.0.0"/>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:name>tempest-device-tagging-server-119886115</nova:name>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:creationTime>2023-08-15 21:19:10</nova:creationTime>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:flavor name="m1.tiny">
Aug 15 21:19:10 user nova-compute[72992]:     <nova:memory>512</nova:memory>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:disk>1</nova:disk>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:swap>0</nova:swap>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:flavor>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:owner>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:user uuid="0e935193250644d0be567384b67f9ec5">tempest-TaggedAttachmentsTest-987160919-project-member</nova:user>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:project uuid="693312b581614a3cad720c85a9bf1e8e">tempest-TaggedAttachmentsTest-987160919</nova:project>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:owner>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:10 user nova-compute[72992]:   <nova:ports>
Aug 15 21:19:10 user nova-compute[72992]:     <nova:port uuid="c7f27105-873a-43db-b06f-51242eeaf115">
Aug 15 21:19:10 user nova-compute[72992]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 21:19:10 user nova-compute[72992]:     </nova:port>
Aug 15 21:19:10 user nova-compute[72992]:   </nova:ports>
Aug 15 21:19:10 user nova-compute[72992]: </nova:instance>
Aug 15 21:19:10 user nova-compute[72992]:  {{(pid=72992) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'flavor' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.607s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.634s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:19:10 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:19:10 user nova-compute[72992]: INFO nova.compute.claims [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Claim successful on node user
Aug 15 21:19:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [{"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Releasing lock "refresh_cache-ac18f6fd-751f-4a70-88b8-678eca326268" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-317350cf-b0a8-48b4-a326-e9e445d1cd27 req-4e88cf46-24cf-482c-9a7b-720b56f06793 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-317350cf-b0a8-48b4-a326-e9e445d1cd27 req-4e88cf46-24cf-482c-9a7b-720b56f06793 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-317350cf-b0a8-48b4-a326-e9e445d1cd27 req-4e88cf46-24cf-482c-9a7b-720b56f06793 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-317350cf-b0a8-48b4-a326-e9e445d1cd27 req-4e88cf46-24cf-482c-9a7b-720b56f06793 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-317350cf-b0a8-48b4-a326-e9e445d1cd27 req-4e88cf46-24cf-482c-9a7b-720b56f06793 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:11 user nova-compute[72992]: WARNING nova.compute.manager [req-317350cf-b0a8-48b4-a326-e9e445d1cd27 req-4e88cf46-24cf-482c-9a7b-720b56f06793 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:11 user nova-compute[72992]: INFO nova.compute.manager [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Terminating instance
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4db5f889-fcaa-427c-97ae-9f7c1d2db5d4 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "interface-ac18f6fd-751f-4a70-88b8-678eca326268-08493643-877c-4312-95bd-f98d4bc9fb21" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.994s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance destroyed successfully.
Aug 15 21:19:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.325s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:19:12 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:19:12 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Instance destroyed successfully.
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.objects.instance [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'resources' on Instance uuid 412a57dc-d6a0-44ec-a661-05fed5309955 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-465251854',display_name='tempest-AttachVolumeNegativeTest-server-465251854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-465251854',id=7,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1SJQz80oAmprppTc5CSuF7GyYxBfTeFVYk5Z1F1NzZ/6kKplZuODQzITDugRE9jHfduoR3kC/zpcoK0XYfTrU8O+5yC9AvttX+oamvMFuFYJjmGxXU3dokHlD2F0PrkA==',key_name='tempest-keypair-1668794078',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-1gh0247b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=412a57dc-d6a0-44ec-a661-05fed5309955,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "af2b7efa-961f-4412-923a-4698c8b198bc", "address": "fa:16:3e:47:e0:4a", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2b7efa-96", "ovs_interfaceid": "af2b7efa-961f-4412-923a-4698c8b198bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=af2b7efa-961f-4412-923a-4698c8b198bc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2b7efa-96') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG os_vif [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=af2b7efa-961f-4412-923a-4698c8b198bc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2b7efa-96') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf2b7efa-96, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.policy [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9781f9aa2f141d8a96849d4c90dd553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407b4e631e745479767ab32173a57f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:19:12 user nova-compute[72992]: INFO os_vif [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=af2b7efa-961f-4412-923a-4698c8b198bc,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2b7efa-96')
Aug 15 21:19:12 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Deleting instance files /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955_del
Aug 15 21:19:12 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Deletion of /opt/stack/data/nova/instances/412a57dc-d6a0-44ec-a661-05fed5309955_del complete
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:19:12 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Creating image(s)
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "/opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "/opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "/opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:12 user nova-compute[72992]: INFO nova.compute.manager [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Took 1.56 seconds to destroy the instance on the hypervisor.
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing instance network info cache due to event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.network.neutron [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updating instance_info_cache with network_info: [{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk 1073741824" returned: 0 in 0.053s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:13 user nova-compute[72992]: WARNING nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-vif-unplugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] No waiting events found dispatching network-vif-unplugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-vif-unplugged-af2b7efa-961f-4412-923a-4698c8b198bc for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Acquiring lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] Lock "412a57dc-d6a0-44ec-a661-05fed5309955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] No waiting events found dispatching network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:13 user nova-compute[72992]: WARNING nova.compute.manager [req-8fa1970f-fb16-45b5-8b21-31e52db8d6ef req-7f65bd8d-59ec-40f8-8251-17fc78735dc1 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received unexpected event network-vif-plugged-af2b7efa-961f-4412-923a-4698c8b198bc for instance with vm_state active and task_state deleting.
Aug 15 21:19:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Cannot resize image /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'migration_context' on Instance uuid 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Ensure instance console log exists: /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:13 user nova-compute[72992]: INFO nova.compute.manager [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Detaching volume ef79e12b-68d1-4205-845d-a38866af8722
Aug 15 21:19:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:13 user nova-compute[72992]: INFO nova.virt.block_device [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Attempting to driver detach volume ef79e12b-68d1-4205-845d-a38866af8722 from mountpoint /dev/vdb
Aug 15 21:19:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Attempting to detach device vdb from instance b198f99d-1575-4ac1-9f66-47d12fda99d9 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:19:13 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:19:13 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:19:13 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:19:13 user nova-compute[72992]:   <serial>ef79e12b-68d1-4205-845d-a38866af8722</serial>
Aug 15 21:19:13 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:19:13 user nova-compute[72992]: </disk>
Aug 15 21:19:13 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully detached device vdb from instance b198f99d-1575-4ac1-9f66-47d12fda99d9 from the persistent domain config.
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b198f99d-1575-4ac1-9f66-47d12fda99d9 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:19:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:19:13 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:19:13 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:19:13 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:19:13 user nova-compute[72992]:   <serial>ef79e12b-68d1-4205-845d-a38866af8722</serial>
Aug 15 21:19:13 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:19:13 user nova-compute[72992]: </disk>
Aug 15 21:19:13 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134354.3641005, b198f99d-1575-4ac1-9f66-47d12fda99d9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:19:14 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully detached device vdb from instance b198f99d-1575-4ac1-9f66-47d12fda99d9 from the live domain config.
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QjSWKHxh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:19:14 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[89925ccd-957b-41c6-8098-fc4de0f05fd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[27768052-eaad-46ec-9d45-94020d97ca36]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64f48670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[041ce021-4149-4d7c-89bc-34681075fd41]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808ca11-cbb3-4741-9f4f-d84c58ed1939]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b649e9-cb8c-4541-9565-f338e77f3dbb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[473c80e5-c6dc-4ed2-9469-7450db3fe8f2]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a34c46d-0f64-471c-b390-5e8c41b7c2be]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cdf050-0071-47f4-8b50-8ac582454e11]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260]
Aug 15 21:19:14 user nova-compute[72992]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722, portal: 172.16.0.220,3260] successful.
Aug 15 21:19:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef79e12b-68d1-4205-845d-a38866af8722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[835638e8-7edf-4051-be11-fef9b9325681]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== disconnect_volume: return (337ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updated VIF entry in instance network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f3a8e6e2-cbc8-4f26-ae3f-ca95d3afe433 req-960520ae-dd2a-41e0-8f4d-cdc49ac72244 service nova] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing instance network info cache due to event network-changed-5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] Acquiring lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] Acquired lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Refreshing network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:19:14 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:15 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Took 2.36 seconds to deallocate network for instance.
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Successfully created port: 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-cba60b03-c44f-4661-916d-347b0cc326b5 req-685cd2a6-006a-4d9f-b614-6c401aa67160 service nova] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Received event network-vif-deleted-af2b7efa-961f-4412-923a-4698c8b198bc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:15 user nova-compute[72992]: WARNING nova.compute.manager [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:15 user nova-compute[72992]: WARNING nova.compute.manager [req-c88dec59-dd98-4053-adb8-b41e10b3e49b req-3347fe73-aea8-4fe1-9dae-4ae6cb9ef104 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d89d8910-55c2-4704-a663-70487e8c93d1 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for d7297eef-0545-4a9b-bc17-0cc9eed179d0 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134355.5736582, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:15 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] VM Resumed (Lifecycle Event)
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:19:15 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Deleted allocations for instance 412a57dc-d6a0-44ec-a661-05fed5309955
Aug 15 21:19:15 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134355.5739074, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:15 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] VM Started (Lifecycle Event)
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0b6a8a8f-b470-43dc-be5f-02ab29dd375d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.871s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-13949e5a-4b60-4ba6-9382-854b884d77f9 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "412a57dc-d6a0-44ec-a661-05fed5309955" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.717s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.network.neutron [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updated VIF entry in instance network info cache for port 5a2e316b-e6ab-434c-839b-5b914d72a5d4. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG nova.network.neutron [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [{"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7351ed6a-cbec-4d23-9c67-e7833c3c0adb req-b4ed3c0c-814a-4809-91d4-f7d8c93ea286 service nova] Releasing lock "refresh_cache-d7297eef-0545-4a9b-bc17-0cc9eed179d0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f281343e-985c-4388-8d28-1d24410a99f4 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f281343e-985c-4388-8d28-1d24410a99f4 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f281343e-985c-4388-8d28-1d24410a99f4 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f281343e-985c-4388-8d28-1d24410a99f4 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72992) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG nova.objects.instance [None req-f281343e-985c-4388-8d28-1d24410a99f4 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Successfully updated port: 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquired lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:16 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance destroyed successfully.
Aug 15 21:19:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f281343e-985c-4388-8d28-1d24410a99f4 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f281343e-985c-4388-8d28-1d24410a99f4 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.899s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating instance_info_cache with network_info: [{"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Releasing lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Instance network_info: |[{"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Start _get_guest_xml network_info=[{"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:19:17 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:19:17 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1175731668',display_name='tempest-TestStampPattern-server-1175731668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1175731668',id=18,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ9LQPzLnABcv71N9nYVWL+Fn/RdNmnzmuhnw6hO4OzBLkxgpbGKUob3hEumkbgp7aK0Sa2W4LWJ91yJuRehLK1Oo45fCKFQi/ADJDWYyb1i99bkbDTJmf0wrBW4+wheg==',key_name='tempest-TestStampPattern-46122809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3407b4e631e745479767ab32173a57f9',ramdisk_id='',reservation_id='r-z2hvr0gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2084179488',owner_user_name='tempest-TestStampPattern-2084179488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:19:12Z,user_data=None,user_id='f9781f9aa2f141d8a96849d4c90dd553',uuid=5023ba98-b30a-4362-a183-7366a52d0feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converting VIF {"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:71:88,bridge_name='br-int',has_traffic_filtering=True,id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f5b46c-b3') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'pci_devices' on Instance uuid 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:19:17 user nova-compute[72992]:   <uuid>5023ba98-b30a-4362-a183-7366a52d0feb</uuid>
Aug 15 21:19:17 user nova-compute[72992]:   <name>instance-00000012</name>
Aug 15 21:19:17 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:19:17 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:19:17 user nova-compute[72992]:   <metadata>
Aug 15 21:19:17 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:17 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:19:17 user nova-compute[72992]:       <nova:name>tempest-TestStampPattern-server-1175731668</nova:name>
Aug 15 21:19:17 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:19:17</nova:creationTime>
Aug 15 21:19:17 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:19:17 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:19:17 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:19:17 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:19:17 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:17 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:17 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:19:17 user nova-compute[72992]:       <nova:owner>
Aug 15 21:19:17 user nova-compute[72992]:         <nova:user uuid="f9781f9aa2f141d8a96849d4c90dd553">tempest-TestStampPattern-2084179488-project-member</nova:user>
Aug 15 21:19:17 user nova-compute[72992]:         <nova:project uuid="3407b4e631e745479767ab32173a57f9">tempest-TestStampPattern-2084179488</nova:project>
Aug 15 21:19:17 user nova-compute[72992]:       </nova:owner>
Aug 15 21:19:17 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:17 user nova-compute[72992]:       <nova:ports>
Aug 15 21:19:17 user nova-compute[72992]:         <nova:port uuid="66f5b46c-b3ce-4fd4-9c52-f531912e7cc2">
Aug 15 21:19:17 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:19:17 user nova-compute[72992]:         </nova:port>
Aug 15 21:19:17 user nova-compute[72992]:       </nova:ports>
Aug 15 21:19:17 user nova-compute[72992]:     </nova:instance>
Aug 15 21:19:17 user nova-compute[72992]:   </metadata>
Aug 15 21:19:17 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:19:17 user nova-compute[72992]:     <system>
Aug 15 21:19:17 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:19:17 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:19:17 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:19:17 user nova-compute[72992]:       <entry name="serial">5023ba98-b30a-4362-a183-7366a52d0feb</entry>
Aug 15 21:19:17 user nova-compute[72992]:       <entry name="uuid">5023ba98-b30a-4362-a183-7366a52d0feb</entry>
Aug 15 21:19:17 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:19:17 user nova-compute[72992]:     </system>
Aug 15 21:19:17 user nova-compute[72992]:   </sysinfo>
Aug 15 21:19:17 user nova-compute[72992]:   <os>
Aug 15 21:19:17 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:19:17 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:19:17 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:19:17 user nova-compute[72992]:   </os>
Aug 15 21:19:17 user nova-compute[72992]:   <features>
Aug 15 21:19:17 user nova-compute[72992]:     <acpi/>
Aug 15 21:19:17 user nova-compute[72992]:     <apic/>
Aug 15 21:19:17 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:19:17 user nova-compute[72992]:   </features>
Aug 15 21:19:17 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:19:17 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:19:17 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:19:17 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:19:17 user nova-compute[72992]:   </clock>
Aug 15 21:19:17 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:19:17 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:19:17 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:19:17 user nova-compute[72992]:   </cpu>
Aug 15 21:19:17 user nova-compute[72992]:   <devices>
Aug 15 21:19:17 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:19:17 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:19:17 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk"/>
Aug 15 21:19:17 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:19:17 user nova-compute[72992]:     </disk>
Aug 15 21:19:17 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:19:17 user nova-compute[72992]:       <mac address="fa:16:3e:18:71:88"/>
Aug 15 21:19:17 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:19:17 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:19:17 user nova-compute[72992]:       <target dev="tap66f5b46c-b3"/>
Aug 15 21:19:17 user nova-compute[72992]:     </interface>
Aug 15 21:19:17 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:19:17 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/console.log" append="off"/>
Aug 15 21:19:17 user nova-compute[72992]:     </serial>
Aug 15 21:19:17 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:19:17 user nova-compute[72992]:     <video>
Aug 15 21:19:17 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:19:17 user nova-compute[72992]:     </video>
Aug 15 21:19:17 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:19:17 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:19:17 user nova-compute[72992]:     </rng>
Aug 15 21:19:17 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:19:17 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:19:17 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:19:17 user nova-compute[72992]:     </memballoon>
Aug 15 21:19:17 user nova-compute[72992]:   </devices>
Aug 15 21:19:17 user nova-compute[72992]: </domain>
Aug 15 21:19:17 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1175731668',display_name='tempest-TestStampPattern-server-1175731668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1175731668',id=18,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ9LQPzLnABcv71N9nYVWL+Fn/RdNmnzmuhnw6hO4OzBLkxgpbGKUob3hEumkbgp7aK0Sa2W4LWJ91yJuRehLK1Oo45fCKFQi/ADJDWYyb1i99bkbDTJmf0wrBW4+wheg==',key_name='tempest-TestStampPattern-46122809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3407b4e631e745479767ab32173a57f9',ramdisk_id='',reservation_id='r-z2hvr0gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2084179488',owner_user_name='tempest-TestStampPattern-2084179488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:19:12Z,user_data=None,user_id='f9781f9aa2f141d8a96849d4c90dd553',uuid=5023ba98-b30a-4362-a183-7366a52d0feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converting VIF {"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:71:88,bridge_name='br-int',has_traffic_filtering=True,id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f5b46c-b3') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG os_vif [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:71:88,bridge_name='br-int',has_traffic_filtering=True,id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f5b46c-b3') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-changed-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Refreshing instance network info cache due to event network-changed-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Acquiring lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Acquired lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Refreshing network info cache for port 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66f5b46c-b3, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66f5b46c-b3, col_values=(('external_ids', {'iface-id': '66f5b46c-b3ce-4fd4-9c52-f531912e7cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:71:88', 'vm-uuid': '5023ba98-b30a-4362-a183-7366a52d0feb'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:17 user nova-compute[72992]: INFO os_vif [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:71:88,bridge_name='br-int',has_traffic_filtering=True,id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f5b46c-b3')
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No VIF found with MAC fa:16:3e:18:71:88, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updated VIF entry in instance network info cache for port 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating instance_info_cache with network_info: [{"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Releasing lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:17 user nova-compute[72992]: WARNING nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state stopped and task_state None.
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:17 user nova-compute[72992]: WARNING nova.compute.manager [req-c94a69e0-6c83-4d35-848a-07baea7d8fe8 req-2f91f41d-9743-4dec-8894-314d5d68c809 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state stopped and task_state None.
Aug 15 21:19:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-d5f756e5-b10d-4280-a2dd-4dfe3aae6851 req-7118e424-6841-4c4c-a948-c1a7c4f9f23b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d5f756e5-b10d-4280-a2dd-4dfe3aae6851 req-7118e424-6841-4c4c-a948-c1a7c4f9f23b service nova] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d5f756e5-b10d-4280-a2dd-4dfe3aae6851 req-7118e424-6841-4c4c-a948-c1a7c4f9f23b service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d5f756e5-b10d-4280-a2dd-4dfe3aae6851 req-7118e424-6841-4c4c-a948-c1a7c4f9f23b service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-d5f756e5-b10d-4280-a2dd-4dfe3aae6851 req-7118e424-6841-4c4c-a948-c1a7c4f9f23b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] No waiting events found dispatching network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:19 user nova-compute[72992]: WARNING nova.compute.manager [req-d5f756e5-b10d-4280-a2dd-4dfe3aae6851 req-7118e424-6841-4c4c-a948-c1a7c4f9f23b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received unexpected event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 for instance with vm_state building and task_state spawning.
Aug 15 21:19:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-13152258-3761-4ae4-924d-398e12ed5cdf req-215309e6-bee3-4f50-a52b-43f8d53f6a1e service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13152258-3761-4ae4-924d-398e12ed5cdf req-215309e6-bee3-4f50-a52b-43f8d53f6a1e service nova] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13152258-3761-4ae4-924d-398e12ed5cdf req-215309e6-bee3-4f50-a52b-43f8d53f6a1e service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-13152258-3761-4ae4-924d-398e12ed5cdf req-215309e6-bee3-4f50-a52b-43f8d53f6a1e service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-13152258-3761-4ae4-924d-398e12ed5cdf req-215309e6-bee3-4f50-a52b-43f8d53f6a1e service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] No waiting events found dispatching network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:21 user nova-compute[72992]: WARNING nova.compute.manager [req-13152258-3761-4ae4-924d-398e12ed5cdf req-215309e6-bee3-4f50-a52b-43f8d53f6a1e service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received unexpected event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 for instance with vm_state building and task_state spawning.
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134361.0439231, 5023ba98-b30a-4362-a183-7366a52d0feb => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] VM Resumed (Lifecycle Event)
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:19:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Instance spawned successfully.
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134361.0451312, 5023ba98-b30a-4362-a183-7366a52d0feb => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] VM Started (Lifecycle Event)
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:19:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:19:21 user nova-compute[72992]: INFO nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Took 8.65 seconds to spawn the instance on the hypervisor.
Aug 15 21:19:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:21 user nova-compute[72992]: INFO nova.compute.manager [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Took 11.50 seconds to build instance.
Aug 15 21:19:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b65e006c-938a-4229-9da7-08703118cda0 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.679s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:19:25 user nova-compute[72992]: INFO nova.compute.claims [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Claim successful on node user
Aug 15 21:19:25 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:19:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.policy [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501fc2d9f61e4b60aaa6b9fad0ef3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf00e7b97164c9ea0527545062823ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:19:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Creating image(s)
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "/opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "/opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "/opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk 1073741824" returned: 0 in 0.054s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Successfully created port: 6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.217s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:19:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Cannot resize image /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'migration_context' on Instance uuid 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Ensure instance console log exists: /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134352.5042968, 412a57dc-d6a0-44ec-a661-05fed5309955 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:27 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] VM Stopped (Lifecycle Event)
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2b54a3df-303f-4433-bad8-c71ca11b70c9 None None] [instance: 412a57dc-d6a0-44ec-a661-05fed5309955] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Successfully updated port: 6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquired lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-changed-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Refreshing instance network info cache due to event network-changed-6db66a63-bcd4-4b52-91bf-3d800b701102. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] Acquiring lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updating instance_info_cache with network_info: [{"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Releasing lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Instance network_info: |[{"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] Acquired lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Refreshing network info cache for port 6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Start _get_guest_xml network_info=[{"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:19:28 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:19:28 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2056642060',display_name='tempest-VolumesAdminNegativeTest-server-2056642060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2056642060',id=19,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9tzRYo+6fjeEBvCEf2YJUHE3I3vY0dUUfgnuH5rAEYRssh2j7+e+ZXIbQmdTKUmEjaN8ZSkAzsvx1tYi3oz86xdP1qSiGfUg9/0uIJXXSLDYGoIDHZDMZlr02JEFXZtw==',key_name='tempest-keypair-580252258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf00e7b97164c9ea0527545062823ca',ramdisk_id='',reservation_id='r-d2tnun34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1128814075',owner_user_name='tempest-VolumesAdminNegativeTest-1128814075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501fc2d9f61e4b60aaa6b9fad0ef3029',uuid=79f18fe8-67d4-44f2-95c7-ad93ec3f11c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converting VIF {"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6db66a63-bcd4-4b52-91bf-3d800b701102,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db66a63-bc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'pci_devices' on Instance uuid 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:19:28 user nova-compute[72992]:   <uuid>79f18fe8-67d4-44f2-95c7-ad93ec3f11c6</uuid>
Aug 15 21:19:28 user nova-compute[72992]:   <name>instance-00000013</name>
Aug 15 21:19:28 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:19:28 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:19:28 user nova-compute[72992]:   <metadata>
Aug 15 21:19:28 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:19:28 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:19:28 user nova-compute[72992]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2056642060</nova:name>
Aug 15 21:19:28 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:19:28</nova:creationTime>
Aug 15 21:19:28 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:19:28 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:19:28 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:19:28 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:19:28 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:19:28 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:19:28 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:19:28 user nova-compute[72992]:       <nova:owner>
Aug 15 21:19:28 user nova-compute[72992]:         <nova:user uuid="501fc2d9f61e4b60aaa6b9fad0ef3029">tempest-VolumesAdminNegativeTest-1128814075-project-member</nova:user>
Aug 15 21:19:28 user nova-compute[72992]:         <nova:project uuid="0cf00e7b97164c9ea0527545062823ca">tempest-VolumesAdminNegativeTest-1128814075</nova:project>
Aug 15 21:19:28 user nova-compute[72992]:       </nova:owner>
Aug 15 21:19:28 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:19:28 user nova-compute[72992]:       <nova:ports>
Aug 15 21:19:28 user nova-compute[72992]:         <nova:port uuid="6db66a63-bcd4-4b52-91bf-3d800b701102">
Aug 15 21:19:28 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:19:28 user nova-compute[72992]:         </nova:port>
Aug 15 21:19:28 user nova-compute[72992]:       </nova:ports>
Aug 15 21:19:28 user nova-compute[72992]:     </nova:instance>
Aug 15 21:19:28 user nova-compute[72992]:   </metadata>
Aug 15 21:19:28 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:19:28 user nova-compute[72992]:     <system>
Aug 15 21:19:28 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:19:28 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:19:28 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:19:28 user nova-compute[72992]:       <entry name="serial">79f18fe8-67d4-44f2-95c7-ad93ec3f11c6</entry>
Aug 15 21:19:28 user nova-compute[72992]:       <entry name="uuid">79f18fe8-67d4-44f2-95c7-ad93ec3f11c6</entry>
Aug 15 21:19:28 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:19:28 user nova-compute[72992]:     </system>
Aug 15 21:19:28 user nova-compute[72992]:   </sysinfo>
Aug 15 21:19:28 user nova-compute[72992]:   <os>
Aug 15 21:19:28 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:19:28 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:19:28 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:19:28 user nova-compute[72992]:   </os>
Aug 15 21:19:28 user nova-compute[72992]:   <features>
Aug 15 21:19:28 user nova-compute[72992]:     <acpi/>
Aug 15 21:19:28 user nova-compute[72992]:     <apic/>
Aug 15 21:19:28 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:19:28 user nova-compute[72992]:   </features>
Aug 15 21:19:28 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:19:28 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:19:28 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:19:28 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:19:28 user nova-compute[72992]:   </clock>
Aug 15 21:19:28 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:19:28 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:19:28 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:19:28 user nova-compute[72992]:   </cpu>
Aug 15 21:19:28 user nova-compute[72992]:   <devices>
Aug 15 21:19:28 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:19:28 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:19:28 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk"/>
Aug 15 21:19:28 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:19:28 user nova-compute[72992]:     </disk>
Aug 15 21:19:28 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:19:28 user nova-compute[72992]:       <mac address="fa:16:3e:3b:f1:5b"/>
Aug 15 21:19:28 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:19:28 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:19:28 user nova-compute[72992]:       <target dev="tap6db66a63-bc"/>
Aug 15 21:19:28 user nova-compute[72992]:     </interface>
Aug 15 21:19:28 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:19:28 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/console.log" append="off"/>
Aug 15 21:19:28 user nova-compute[72992]:     </serial>
Aug 15 21:19:28 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:19:28 user nova-compute[72992]:     <video>
Aug 15 21:19:28 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:19:28 user nova-compute[72992]:     </video>
Aug 15 21:19:28 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:19:28 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:19:28 user nova-compute[72992]:     </rng>
Aug 15 21:19:28 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:19:28 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:19:28 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:19:28 user nova-compute[72992]:     </memballoon>
Aug 15 21:19:28 user nova-compute[72992]:   </devices>
Aug 15 21:19:28 user nova-compute[72992]: </domain>
Aug 15 21:19:28 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2056642060',display_name='tempest-VolumesAdminNegativeTest-server-2056642060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2056642060',id=19,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9tzRYo+6fjeEBvCEf2YJUHE3I3vY0dUUfgnuH5rAEYRssh2j7+e+ZXIbQmdTKUmEjaN8ZSkAzsvx1tYi3oz86xdP1qSiGfUg9/0uIJXXSLDYGoIDHZDMZlr02JEFXZtw==',key_name='tempest-keypair-580252258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf00e7b97164c9ea0527545062823ca',ramdisk_id='',reservation_id='r-d2tnun34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1128814075',owner_user_name='tempest-VolumesAdminNegativeTest-1128814075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501fc2d9f61e4b60aaa6b9fad0ef3029',uuid=79f18fe8-67d4-44f2-95c7-ad93ec3f11c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converting VIF {"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6db66a63-bcd4-4b52-91bf-3d800b701102,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db66a63-bc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG os_vif [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6db66a63-bcd4-4b52-91bf-3d800b701102,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db66a63-bc') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6db66a63-bc, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6db66a63-bc, col_values=(('external_ids', {'iface-id': '6db66a63-bcd4-4b52-91bf-3d800b701102', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:f1:5b', 'vm-uuid': '79f18fe8-67d4-44f2-95c7-ad93ec3f11c6'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:28 user nova-compute[72992]: INFO os_vif [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6db66a63-bcd4-4b52-91bf-3d800b701102,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db66a63-bc')
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] No VIF found with MAC fa:16:3e:3b:f1:5b, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updated VIF entry in instance network info cache for port 6db66a63-bcd4-4b52-91bf-3d800b701102. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updating instance_info_cache with network_info: [{"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9c4c5b06-c18c-453d-a2cf-9a22bc691d84 req-b6e13c56-b20f-4a34-b63d-150d66c0fe60 service nova] Releasing lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-4216a430-2888-4bce-9dbf-37f019242d60 req-336c23ed-c410-4ed4-ae73-6ba9da45c4c7 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4216a430-2888-4bce-9dbf-37f019242d60 req-336c23ed-c410-4ed4-ae73-6ba9da45c4c7 service nova] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4216a430-2888-4bce-9dbf-37f019242d60 req-336c23ed-c410-4ed4-ae73-6ba9da45c4c7 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4216a430-2888-4bce-9dbf-37f019242d60 req-336c23ed-c410-4ed4-ae73-6ba9da45c4c7 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-4216a430-2888-4bce-9dbf-37f019242d60 req-336c23ed-c410-4ed4-ae73-6ba9da45c4c7 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] No waiting events found dispatching network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:29 user nova-compute[72992]: WARNING nova.compute.manager [req-4216a430-2888-4bce-9dbf-37f019242d60 req-336c23ed-c410-4ed4-ae73-6ba9da45c4c7 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received unexpected event network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 for instance with vm_state building and task_state spawning.
Aug 15 21:19:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134371.6974723, 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] VM Resumed (Lifecycle Event)
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Instance spawned successfully.
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134371.6976302, 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] VM Started (Lifecycle Event)
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-9322aec3-b699-4d70-a867-6ceec300d10f req-84e963ba-2810-4a53-bc52-1cf5ae288c07 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9322aec3-b699-4d70-a867-6ceec300d10f req-84e963ba-2810-4a53-bc52-1cf5ae288c07 service nova] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9322aec3-b699-4d70-a867-6ceec300d10f req-84e963ba-2810-4a53-bc52-1cf5ae288c07 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9322aec3-b699-4d70-a867-6ceec300d10f req-84e963ba-2810-4a53-bc52-1cf5ae288c07 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-9322aec3-b699-4d70-a867-6ceec300d10f req-84e963ba-2810-4a53-bc52-1cf5ae288c07 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] No waiting events found dispatching network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:31 user nova-compute[72992]: WARNING nova.compute.manager [req-9322aec3-b699-4d70-a867-6ceec300d10f req-84e963ba-2810-4a53-bc52-1cf5ae288c07 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received unexpected event network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 for instance with vm_state building and task_state spawning.
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134356.8646085, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Stopped (Lifecycle Event)
Aug 15 21:19:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:31 user nova-compute[72992]: INFO nova.compute.manager [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Took 6.72 seconds to build instance.
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8ea1d8a0-7c49-4e74-8dbb-c7620060f042 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8ea1d8a0-7c49-4e74-8dbb-c7620060f042 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:19:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b34d53ad-6bb0-4182-9e9b-ee662ebe7027 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.839s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:44 user nova-compute[72992]: INFO nova.compute.manager [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Detaching volume a0f3845b-ed4b-46e0-9fb8-45dec943fbbe
Aug 15 21:19:44 user nova-compute[72992]: INFO nova.virt.block_device [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Attempting to driver detach volume a0f3845b-ed4b-46e0-9fb8-45dec943fbbe from mountpoint /dev/vdb
Aug 15 21:19:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Attempting to detach device vdb from instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:19:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:19:44 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:19:44 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:19:44 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:19:44 user nova-compute[72992]:   <serial>a0f3845b-ed4b-46e0-9fb8-45dec943fbbe</serial>
Aug 15 21:19:44 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:19:44 user nova-compute[72992]: </disk>
Aug 15 21:19:44 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:44 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Successfully detached device vdb from instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 from the persistent domain config.
Aug 15 21:19:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:19:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:19:44 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:19:44 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:19:44 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:19:44 user nova-compute[72992]:   <serial>a0f3845b-ed4b-46e0-9fb8-45dec943fbbe</serial>
Aug 15 21:19:44 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:19:44 user nova-compute[72992]: </disk>
Aug 15 21:19:44 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134385.318452, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:19:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Successfully detached device vdb from instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 from the live domain config.
Aug 15 21:19:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIQBsCtv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:19:45 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[593e5c77-7634-4aea-b755-fa648aa71c3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d821bf-35f9-4f60-b83d-653ed6870234]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:45 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0cb7b58d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e841f7-a0b3-4554-9a2b-670377285c87]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[04797a64-748a-4d35-9b8d-2db84d12707b]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a016dda-d43d-4ddd-9b74-3a6a2a7e1447]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ae131-6c8c-482c-836a-677318a000b7]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f082b79-346c-4822-b45c-652b54c73c19]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ff926f-d1f9-44b7-92ba-499aecc4c3b2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260]
Aug 15 21:19:45 user nova-compute[72992]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe, portal: 172.16.0.220,3260] successful.
Aug 15 21:19:45 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f3845b-ed4b-46e0-9fb8-45dec943fbbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6ad5b2-22cb-44e7-ac4c-88dbc83ba622]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] <== disconnect_volume: return (298ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:19:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:19:46 user nova-compute[72992]: DEBUG nova.objects.instance [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'flavor' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-57c208a4-e4ce-4b75-b857-69df831fa1e8 tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.639s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing instance network info cache due to event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:19:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updated VIF entry in instance network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f943a4ca-af73-48d5-97c8-9c176b1958d6 req-f1e91f8a-ed99-4e79-be69-5600256dcc5c service nova] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:48 user nova-compute[72992]: INFO nova.compute.manager [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Shelve offloading
Aug 15 21:19:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance destroyed successfully.
Aug 15 21:19:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-unplugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-unplugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:49 user nova-compute[72992]: WARNING nova.compute.manager [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received unexpected event network-vif-unplugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with vm_state active and task_state shelving.
Aug 15 21:19:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:49 user nova-compute[72992]: WARNING nova.compute.manager [req-1380bf70-a9af-4b19-b90c-7bec15b28fb5 req-1066f8a2-2766-46ce-a872-29e9c427e3a1 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received unexpected event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with vm_state active and task_state shelving.
Aug 15 21:19:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance destroyed successfully.
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'resources' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-273239992',display_name='tempest-TestShelveInstance-server-273239992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-273239992',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLairPAAwvAX2jiTJ099QyJUqxtL2jIpk9nCo2wSzOMbPg5kCoaKE2Ih7euYv4rQIUeKBc2YSt299/p/DDBMFtMYqkgkMYnk8rDscE3tTkzwkKhsjwR83q0qfFNRi1XYQ==',key_name='tempest-TestShelveInstance-172315357',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c2b71054a944de87abfb5fad8101d1',ramdisk_id='',reservation_id='r-7jqfcmob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-526170969',owner_user_name='tempest-TestShelveInstance-526170969-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:21Z,user_data=None,user_id='44b6f1facf97472fb22015645ce76a82',uuid=9ee81390-8064-4a06-893e-d5238e4b06bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converting VIF {"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_vif [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap438b1af6-fc, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing instance network info cache due to event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:50 user nova-compute[72992]: INFO os_vif [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc')
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:19:50 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[265320fa-80b3-462b-910e-ed30d9a326fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[052a4dae-e964-45fd-8b14-b49abd4fe229]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:19:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c885ae680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'): ({'sde'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Removing single pathed devices sde {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7475a62f-3e0f-4cf4-acab-f8f7cf745ae1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4421b30a-49ea-47db-89d1-93d9d0edbd44]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Flushing IO for device /dev/sde {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[493bb105-8765-40a0-9ee2-9bf6db631485]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5b289-d016-4c5d-bc0a-e919e090a923]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c39ee71-da4b-434e-a65e-0a06d83190a3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbbeb29-6c8b-43af-8063-8818bb4be167]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]
Aug 15 21:19:50 user nova-compute[72992]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.
Aug 15 21:19:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e7627a-4ea0-45d7-b845-09b991922085]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] <== disconnect_volume: return (311ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:19:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Deleting instance files /opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc_del
Aug 15 21:19:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Deletion of /opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc_del complete
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updated VIF entry in instance network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": null, "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap438b1af6-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c136d43f-474e-46bf-bd6e-edc9b4ab41d8 req-9dc49560-dabe-41ef-9b93-2003aea4571f service nova] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:51 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Deleted allocations for instance 9ee81390-8064-4a06-893e-d5238e4b06bc
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0d236fbc-3ed6-440c-8bcc-d639dfd25366 tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.666s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 217026e1-b750-4861-8806-f0d87eaabb45 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 5b5143db-39e5-4962-a85d-fe6cd0cdb45d {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "217026e1-b750-4861-8806-f0d87eaabb45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e52158f6-519d-4a8f-99d6-756e64385366" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:51 user nova-compute[72992]: WARNING oslo_messaging._drivers.amqpdriver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "217026e1-b750-4861-8806-f0d87eaabb45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e52158f6-519d-4a8f-99d6-756e64385366" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:55 user nova-compute[72992]: INFO nova.compute.manager [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Unrescuing
Aug 15 21:19:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:19:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:55 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'flavor' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-d4154261-4130-4926-a715-c5b5f0c53987 req-6b8f4046-edbc-4e8d-ba1b-ba902da5a24e service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4154261-4130-4926-a715-c5b5f0c53987 req-6b8f4046-edbc-4e8d-ba1b-ba902da5a24e service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4154261-4130-4926-a715-c5b5f0c53987 req-6b8f4046-edbc-4e8d-ba1b-ba902da5a24e service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4154261-4130-4926-a715-c5b5f0c53987 req-6b8f4046-edbc-4e8d-ba1b-ba902da5a24e service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-d4154261-4130-4926-a715-c5b5f0c53987 req-6b8f4046-edbc-4e8d-ba1b-ba902da5a24e service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:56 user nova-compute[72992]: WARNING nova.compute.manager [req-d4154261-4130-4926-a715-c5b5f0c53987 req-6b8f4046-edbc-4e8d-ba1b-ba902da5a24e service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:56 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance destroyed successfully.
Aug 15 21:19:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: INFO nova.compute.manager [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Unrescuing
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:58 user nova-compute[72992]: WARNING nova.compute.manager [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:58 user nova-compute[72992]: WARNING nova.compute.manager [req-d4d148c5-c61b-4ee2-8aa9-911b3cb460ff req-f23ae08d-1802-4f23-baea-8133e4e470e0 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating instance_info_cache with network_info: [{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'flavor' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:58 user nova-compute[72992]: INFO nova.compute.manager [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Terminating instance
Aug 15 21:19:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:19:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-71c28ecc-3687-436e-b222-27e0cd330b7c req-ef5d8a00-9a54-448a-be9a-9fe8d89b54fc service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71c28ecc-3687-436e-b222-27e0cd330b7c req-ef5d8a00-9a54-448a-be9a-9fe8d89b54fc service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71c28ecc-3687-436e-b222-27e0cd330b7c req-ef5d8a00-9a54-448a-be9a-9fe8d89b54fc service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71c28ecc-3687-436e-b222-27e0cd330b7c req-ef5d8a00-9a54-448a-be9a-9fe8d89b54fc service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-71c28ecc-3687-436e-b222-27e0cd330b7c req-ef5d8a00-9a54-448a-be9a-9fe8d89b54fc service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:19:59 user nova-compute[72992]: WARNING nova.compute.manager [req-71c28ecc-3687-436e-b222-27e0cd330b7c req-ef5d8a00-9a54-448a-be9a-9fe8d89b54fc service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance destroyed successfully.
Aug 15 21:19:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:19:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Instance destroyed successfully.
Aug 15 21:19:59 user nova-compute[72992]: DEBUG nova.objects.instance [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lazy-loading 'resources' on Instance uuid ac18f6fd-751f-4a70-88b8-678eca326268 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-119886115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-119886115',id=14,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsvqi3S4sZ5vA78QRSCb2B1MHnKmukl2xTb4Ccoq+UuymbiFadfbWJEdtqTb0iJisfoK/XcPPxKpijlIXxKKdjU3pdzOVRrYfzK/MmZrAdu3163lfkT+0mDaj4vO3Fv5w==',key_name='tempest-keypair-141320666',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='693312b581614a3cad720c85a9bf1e8e',ramdisk_id='',reservation_id='r-qpjkalku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-987160919',owner_user_name='tempest-TaggedAttachmentsTest-987160919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:17:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e935193250644d0be567384b67f9ec5',uuid=ac18f6fd-751f-4a70-88b8-678eca326268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converting VIF {"id": "c7f27105-873a-43db-b06f-51242eeaf115", "address": "fa:16:3e:09:74:ea", "network": {"id": "d9538c63-8c61-49b4-b856-284c099870d1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-623470221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "693312b581614a3cad720c85a9bf1e8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f27105-87", "ovs_interfaceid": "c7f27105-873a-43db-b06f-51242eeaf115", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:74:ea,bridge_name='br-int',has_traffic_filtering=True,id=c7f27105-873a-43db-b06f-51242eeaf115,network=Network(d9538c63-8c61-49b4-b856-284c099870d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f27105-87') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG os_vif [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:74:ea,bridge_name='br-int',has_traffic_filtering=True,id=c7f27105-873a-43db-b06f-51242eeaf115,network=Network(d9538c63-8c61-49b4-b856-284c099870d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f27105-87') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7f27105-87, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: INFO os_vif [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:74:ea,bridge_name='br-int',has_traffic_filtering=True,id=c7f27105-873a-43db-b06f-51242eeaf115,network=Network(d9538c63-8c61-49b4-b856-284c099870d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f27105-87')
Aug 15 21:20:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Deleting instance files /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268_del
Aug 15 21:20:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Deletion of /opt/stack/data/nova/instances/ac18f6fd-751f-4a70-88b8-678eca326268_del complete
Aug 15 21:20:00 user nova-compute[72992]: INFO nova.compute.manager [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 15 21:20:00 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-97242418-e83f-4ff4-9602-8700039c6d6d req-6f035871-2664-401c-9f1f-6323c8a9fece service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-97242418-e83f-4ff4-9602-8700039c6d6d req-6f035871-2664-401c-9f1f-6323c8a9fece service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-97242418-e83f-4ff4-9602-8700039c6d6d req-6f035871-2664-401c-9f1f-6323c8a9fece service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-97242418-e83f-4ff4-9602-8700039c6d6d req-6f035871-2664-401c-9f1f-6323c8a9fece service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-97242418-e83f-4ff4-9602-8700039c6d6d req-6f035871-2664-401c-9f1f-6323c8a9fece service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:00 user nova-compute[72992]: WARNING nova.compute.manager [req-97242418-e83f-4ff4-9602-8700039c6d6d req-6f035871-2664-401c-9f1f-6323c8a9fece service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c65a7c3c-bf41-47cf-8816-eee10cdf6d06 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for a6e7c604-49e8-47af-a81f-2da89401ea96 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134400.666304, a6e7c604-49e8-47af-a81f-2da89401ea96 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] VM Resumed (Lifecycle Event)
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134400.6670067, a6e7c604-49e8-47af-a81f-2da89401ea96 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] VM Started (Lifecycle Event)
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:01 user nova-compute[72992]: WARNING nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-unplugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-unplugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-unplugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:01 user nova-compute[72992]: WARNING nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with vm_state active and task_state deleting.
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:01 user nova-compute[72992]: WARNING nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with vm_state active and task_state deleting.
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:01 user nova-compute[72992]: WARNING nova.compute.manager [req-e59c1e9a-9183-4ffa-b493-75f7e0edafe0 req-a77a01d0-01c1-4f4d-925b-3385a34cc92c service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with vm_state active and task_state deleting.
Aug 15 21:20:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:02 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:02 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Took 2.29 seconds to deallocate network for instance.
Aug 15 21:20:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:02 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:20:02 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:20:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:02 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Deleted allocations for instance ac18f6fd-751f-4a70-88b8-678eca326268
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f80ace9e-e1df-4817-b76b-edea058a55b1 tempest-TaggedAttachmentsTest-987160919 tempest-TaggedAttachmentsTest-987160919-project-member] Lock "ac18f6fd-751f-4a70-88b8-678eca326268" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.146s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-unplugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-unplugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:03 user nova-compute[72992]: WARNING nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-unplugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with vm_state deleted and task_state None.
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Acquiring lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "ac18f6fd-751f-4a70-88b8-678eca326268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] No waiting events found dispatching network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:03 user nova-compute[72992]: WARNING nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received unexpected event network-vif-plugged-c7f27105-873a-43db-b06f-51242eeaf115 for instance with vm_state deleted and task_state None.
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Received event network-vif-deleted-c7f27105-873a-43db-b06f-51242eeaf115 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:03 user nova-compute[72992]: WARNING nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:03 user nova-compute[72992]: WARNING nova.compute.manager [req-42d85484-867d-4dfc-b515-9bc0efb38ef9 req-e485f090-701c-4446-a8e5-f413290b8f3d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for 76c6d54f-938e-42a0-84d6-659e38f21bb8 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134403.6636121, 76c6d54f-938e-42a0-84d6-659e38f21bb8 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:03 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] VM Resumed (Lifecycle Event)
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-709c9dbd-6920-4d0f-b513-c21ea13544bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:20:03 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134403.665065, 76c6d54f-938e-42a0-84d6-659e38f21bb8 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:03 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] VM Started (Lifecycle Event)
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134388.9153636, 9ee81390-8064-4a06-893e-d5238e4b06bc => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:03 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] VM Stopped (Lifecycle Event)
Aug 15 21:20:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-bc20afd7-13b8-4025-aa15-eb7ffbccb9ed None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:04 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:20:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:20:05 user nova-compute[72992]: INFO nova.compute.claims [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Claim successful on node user
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:20:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.policy [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd12f60b35e7843838c7dcfb4487dee7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41e38d3f853443ea9f6352679b3240f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:20:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Creating image(s)
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "/opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk 1073741824" returned: 0 in 0.088s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Successfully created port: 81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Cannot resize image /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'migration_context' on Instance uuid a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Ensure instance console log exists: /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Successfully updated port: 81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquired lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-changed-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Refreshing instance network info cache due to event network-changed-81d960fd-8d18-453b-b0d8-19031c669131. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] Acquiring lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:20:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:20:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7335MB free_disk=25.507247924804688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d7297eef-0545-4a9b-bc17-0cc9eed179d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5b5143db-39e5-4962-a85d-fe6cd0cdb45d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Updating instance_info_cache with network_info: [{"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Releasing lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Instance network_info: |[{"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] Acquired lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.neutron [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Refreshing network info cache for port 81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Start _get_guest_xml network_info=[{"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:20:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:20:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-98728588',display_name='tempest-AttachVolumeNegativeTest-server-98728588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-98728588',id=20,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPivA31ecRElxPDqDzfUBkd0ya3fFHPjrFMqfs28ba5zKegyvtuNjjrThC10OLZt42qUx96D/0tZGaEwl6QpVlraM7Tk7MRhXLyi5E/dSQI750KYXmi5mQg4VFm5vjUSHg==',key_name='tempest-keypair-1717924677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-s2yck6rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=a76eaf1d-abb7-4b60-86e4-1e6883cc5f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=81d960fd-8d18-453b-b0d8-19031c669131,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d960fd-8d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'pci_devices' on Instance uuid a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:20:08 user nova-compute[72992]:   <uuid>a76eaf1d-abb7-4b60-86e4-1e6883cc5f56</uuid>
Aug 15 21:20:08 user nova-compute[72992]:   <name>instance-00000014</name>
Aug 15 21:20:08 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:20:08 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:20:08 user nova-compute[72992]:   <metadata>
Aug 15 21:20:08 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:20:08 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:20:08 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeNegativeTest-server-98728588</nova:name>
Aug 15 21:20:08 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:20:08</nova:creationTime>
Aug 15 21:20:08 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:20:08 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:20:08 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:20:08 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:20:08 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:20:08 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:20:08 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:20:08 user nova-compute[72992]:       <nova:owner>
Aug 15 21:20:08 user nova-compute[72992]:         <nova:user uuid="d12f60b35e7843838c7dcfb4487dee7d">tempest-AttachVolumeNegativeTest-1657501102-project-member</nova:user>
Aug 15 21:20:08 user nova-compute[72992]:         <nova:project uuid="b41e38d3f853443ea9f6352679b3240f">tempest-AttachVolumeNegativeTest-1657501102</nova:project>
Aug 15 21:20:08 user nova-compute[72992]:       </nova:owner>
Aug 15 21:20:08 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:20:08 user nova-compute[72992]:       <nova:ports>
Aug 15 21:20:08 user nova-compute[72992]:         <nova:port uuid="81d960fd-8d18-453b-b0d8-19031c669131">
Aug 15 21:20:08 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 21:20:08 user nova-compute[72992]:         </nova:port>
Aug 15 21:20:08 user nova-compute[72992]:       </nova:ports>
Aug 15 21:20:08 user nova-compute[72992]:     </nova:instance>
Aug 15 21:20:08 user nova-compute[72992]:   </metadata>
Aug 15 21:20:08 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:20:08 user nova-compute[72992]:     <system>
Aug 15 21:20:08 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:20:08 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:20:08 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:20:08 user nova-compute[72992]:       <entry name="serial">a76eaf1d-abb7-4b60-86e4-1e6883cc5f56</entry>
Aug 15 21:20:08 user nova-compute[72992]:       <entry name="uuid">a76eaf1d-abb7-4b60-86e4-1e6883cc5f56</entry>
Aug 15 21:20:08 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:20:08 user nova-compute[72992]:     </system>
Aug 15 21:20:08 user nova-compute[72992]:   </sysinfo>
Aug 15 21:20:08 user nova-compute[72992]:   <os>
Aug 15 21:20:08 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:20:08 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:20:08 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:20:08 user nova-compute[72992]:   </os>
Aug 15 21:20:08 user nova-compute[72992]:   <features>
Aug 15 21:20:08 user nova-compute[72992]:     <acpi/>
Aug 15 21:20:08 user nova-compute[72992]:     <apic/>
Aug 15 21:20:08 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:20:08 user nova-compute[72992]:   </features>
Aug 15 21:20:08 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:20:08 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:20:08 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:20:08 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:20:08 user nova-compute[72992]:   </clock>
Aug 15 21:20:08 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:20:08 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:20:08 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:20:08 user nova-compute[72992]:   </cpu>
Aug 15 21:20:08 user nova-compute[72992]:   <devices>
Aug 15 21:20:08 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:20:08 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:20:08 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk"/>
Aug 15 21:20:08 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:20:08 user nova-compute[72992]:     </disk>
Aug 15 21:20:08 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:20:08 user nova-compute[72992]:       <mac address="fa:16:3e:c3:f2:55"/>
Aug 15 21:20:08 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:20:08 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:20:08 user nova-compute[72992]:       <target dev="tap81d960fd-8d"/>
Aug 15 21:20:08 user nova-compute[72992]:     </interface>
Aug 15 21:20:08 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:20:08 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/console.log" append="off"/>
Aug 15 21:20:08 user nova-compute[72992]:     </serial>
Aug 15 21:20:08 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:20:08 user nova-compute[72992]:     <video>
Aug 15 21:20:08 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:20:08 user nova-compute[72992]:     </video>
Aug 15 21:20:08 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:20:08 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:20:08 user nova-compute[72992]:     </rng>
Aug 15 21:20:08 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:20:08 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:20:08 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:20:08 user nova-compute[72992]:     </memballoon>
Aug 15 21:20:08 user nova-compute[72992]:   </devices>
Aug 15 21:20:08 user nova-compute[72992]: </domain>
Aug 15 21:20:08 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-98728588',display_name='tempest-AttachVolumeNegativeTest-server-98728588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-98728588',id=20,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPivA31ecRElxPDqDzfUBkd0ya3fFHPjrFMqfs28ba5zKegyvtuNjjrThC10OLZt42qUx96D/0tZGaEwl6QpVlraM7Tk7MRhXLyi5E/dSQI750KYXmi5mQg4VFm5vjUSHg==',key_name='tempest-keypair-1717924677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-s2yck6rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:20:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=a76eaf1d-abb7-4b60-86e4-1e6883cc5f56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=81d960fd-8d18-453b-b0d8-19031c669131,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d960fd-8d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG os_vif [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=81d960fd-8d18-453b-b0d8-19031c669131,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d960fd-8d') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81d960fd-8d, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81d960fd-8d, col_values=(('external_ids', {'iface-id': '81d960fd-8d18-453b-b0d8-19031c669131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:f2:55', 'vm-uuid': 'a76eaf1d-abb7-4b60-86e4-1e6883cc5f56'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:09 user nova-compute[72992]: INFO os_vif [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=81d960fd-8d18-453b-b0d8-19031c669131,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d960fd-8d')
Aug 15 21:20:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No VIF found with MAC fa:16:3e:c3:f2:55, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Updated VIF entry in instance network info cache for port 81d960fd-8d18-453b-b0d8-19031c669131. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Updating instance_info_cache with network_info: [{"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4a102b5b-54ce-4c39-9d60-af090ea916c3 req-e2d7b22a-1a73-4167-8b12-1c38e53cd4f5 service nova] Releasing lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-b8bf4376-0232-454b-9545-bd5478b9358d req-e76740b8-fc52-4991-90a5-a1a22f57638e service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b8bf4376-0232-454b-9545-bd5478b9358d req-e76740b8-fc52-4991-90a5-a1a22f57638e service nova] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b8bf4376-0232-454b-9545-bd5478b9358d req-e76740b8-fc52-4991-90a5-a1a22f57638e service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b8bf4376-0232-454b-9545-bd5478b9358d req-e76740b8-fc52-4991-90a5-a1a22f57638e service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-b8bf4376-0232-454b-9545-bd5478b9358d req-e76740b8-fc52-4991-90a5-a1a22f57638e service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] No waiting events found dispatching network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:10 user nova-compute[72992]: WARNING nova.compute.manager [req-b8bf4376-0232-454b-9545-bd5478b9358d req-e76740b8-fc52-4991-90a5-a1a22f57638e service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received unexpected event network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 for instance with vm_state building and task_state spawning.
Aug 15 21:20:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:20:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:20:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134412.6052969, a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:12 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] VM Resumed (Lifecycle Event)
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:20:12 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Instance spawned successfully.
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:20:12 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134412.607621, a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:12 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] VM Started (Lifecycle Event)
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:20:12 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:20:12 user nova-compute[72992]: INFO nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-bfee9bf4-f1f0-45b6-83d8-07857f2741b8 req-547cc0eb-95cb-4ee7-afa4-a2d3b65fc6ed service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bfee9bf4-f1f0-45b6-83d8-07857f2741b8 req-547cc0eb-95cb-4ee7-afa4-a2d3b65fc6ed service nova] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bfee9bf4-f1f0-45b6-83d8-07857f2741b8 req-547cc0eb-95cb-4ee7-afa4-a2d3b65fc6ed service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bfee9bf4-f1f0-45b6-83d8-07857f2741b8 req-547cc0eb-95cb-4ee7-afa4-a2d3b65fc6ed service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-bfee9bf4-f1f0-45b6-83d8-07857f2741b8 req-547cc0eb-95cb-4ee7-afa4-a2d3b65fc6ed service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] No waiting events found dispatching network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:12 user nova-compute[72992]: WARNING nova.compute.manager [req-bfee9bf4-f1f0-45b6-83d8-07857f2741b8 req-547cc0eb-95cb-4ee7-afa4-a2d3b65fc6ed service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received unexpected event network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 for instance with vm_state building and task_state spawning.
Aug 15 21:20:12 user nova-compute[72992]: INFO nova.compute.manager [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Took 7.18 seconds to build instance.
Aug 15 21:20:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c9383604-3caf-47b9-bca2-95520ff92c5f tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.323s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:14 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134399.9722662, ac18f6fd-751f-4a70-88b8-678eca326268 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:14 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] VM Stopped (Lifecycle Event)
Aug 15 21:20:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b81d1d01-1365-47d7-b4c4-ced6b90560a0 None None] [instance: ac18f6fd-751f-4a70-88b8-678eca326268] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-changed-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Refreshing instance network info cache due to event network-changed-fc5d6d0d-096f-4934-afe8-b7e58667def8. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:20:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] Acquiring lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:20:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] Acquired lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:20:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Refreshing network info cache for port fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:29 user nova-compute[72992]: INFO nova.compute.manager [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Rebuilding instance
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'pci_requests' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'resources' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'migration_context' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72992) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-74c3b107-3202-4202-a738-375e8848382a req-9288b0b7-6acf-4e20-8a9d-855e3ef1d6f3 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-unplugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-74c3b107-3202-4202-a738-375e8848382a req-9288b0b7-6acf-4e20-8a9d-855e3ef1d6f3 service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-74c3b107-3202-4202-a738-375e8848382a req-9288b0b7-6acf-4e20-8a9d-855e3ef1d6f3 service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-74c3b107-3202-4202-a738-375e8848382a req-9288b0b7-6acf-4e20-8a9d-855e3ef1d6f3 service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-74c3b107-3202-4202-a738-375e8848382a req-9288b0b7-6acf-4e20-8a9d-855e3ef1d6f3 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No waiting events found dispatching network-vif-unplugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:29 user nova-compute[72992]: WARNING nova.compute.manager [req-74c3b107-3202-4202-a738-375e8848382a req-9288b0b7-6acf-4e20-8a9d-855e3ef1d6f3 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received unexpected event network-vif-unplugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with vm_state active and task_state rebuilding.
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updated VIF entry in instance network info cache for port fc5d6d0d-096f-4934-afe8-b7e58667def8. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updating instance_info_cache with network_info: [{"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-71a72f01-883b-4246-9817-1300ace2a81c req-8805f87f-8e32-43b4-a5bb-1a10c918170c service nova] Releasing lock "refresh_cache-7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:20:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance destroyed successfully.
Aug 15 21:20:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance destroyed successfully.
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-324504329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-507659784',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC4t2+nmaAs27FyCYyguyqSgAe9CAMrpZ/FJByVORIFboOrEkCb/KaQS+ZLSH86GgIZAihoJRBzqLI7XWguwj13w4o9mOJJJMwvJ4f2DudJMu1wqjsl/OIXMlY+zBy31A==',key_name='tempest-keypair-1478025030',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f14274f8917c464eb2583364aac4b207',ramdisk_id='',reservation_id='r-vd8xoz80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-717569970',owner_user_name='tempest-ServerActionsV293TestJSON-717569970-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cebffa69e7640dabdeb9783896d23a6',uuid=7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converting VIF {"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_vif [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc5d6d0d-09, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:30 user nova-compute[72992]: INFO os_vif [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09')
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:20:30 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a5ebc3-ba7c-4acf-ba1c-39eecfb018f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-changed-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing instance network info cache due to event network-changed-12d0e7a1-0166-465c-87c4-b0dd9525132a. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] Acquiring lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] Acquired lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Refreshing network info cache for port 12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a12b2a-88ab-43ff-be94-db32fcd631e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64f17b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'): ({'sdi'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Removing single pathed devices sdi {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f963988-8b57-438d-a3b5-c7b0c92a8811]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f91d0b-e23f-4667-9f0c-539235fb0bc0]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Flushing IO for device /dev/sdi {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea07db21-8a1f-437b-a7f2-286b1864bb77]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f56b450-fa81-4e36-8cfb-7a9deb2fdaa3]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] SCSI volumes sdi have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6c82ae-81c9-405f-9b1a-6c6f321cca6d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8b538e-389d-48b4-8ab7-9321412e01b3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]
Aug 15 21:20:30 user nova-compute[72992]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.
Aug 15 21:20:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a64d469-c69d-4c13-a0e6-9fb0a9f6abb2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] <== disconnect_volume: return (331ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:20:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Deleting instance files /opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c_del
Aug 15 21:20:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Deletion of /opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c_del complete
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updated VIF entry in instance network info cache for port 12d0e7a1-0166-465c-87c4-b0dd9525132a. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [{"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:30 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c could not be found.
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5233a0fe-092e-473e-a39b-364dca7a6942 req-e58131ab-f029-4523-9a66-6df0e31a0371 service nova] Releasing lock "refresh_cache-5b5143db-39e5-4962-a85d-fe6cd0cdb45d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:20:30 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[53055fcc-36ea-4466-b7d2-fd7a82c95f47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead2bf38-dab1-4fb9-8abe-0ff3ea5e2ab8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:30 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0cb7b59630>, {}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Disconnecting from: [] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] <== disconnect_volume: return (53ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:20:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Preparing to wait for external event volume-reimaged-cc30a2b7-9757-4c6c-96ed-f67a203c5842 {{(pid=72992) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-a06ec721-6c7d-4507-80de-7cb246c7acec req-a2f03ced-a129-41cd-b168-9ebacabcd615 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a06ec721-6c7d-4507-80de-7cb246c7acec req-a2f03ced-a129-41cd-b168-9ebacabcd615 service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a06ec721-6c7d-4507-80de-7cb246c7acec req-a2f03ced-a129-41cd-b168-9ebacabcd615 service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a06ec721-6c7d-4507-80de-7cb246c7acec req-a2f03ced-a129-41cd-b168-9ebacabcd615 service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-a06ec721-6c7d-4507-80de-7cb246c7acec req-a2f03ced-a129-41cd-b168-9ebacabcd615 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No event matching network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 in dict_keys([('volume-reimaged', 'cc30a2b7-9757-4c6c-96ed-f67a203c5842')]) {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 15 21:20:31 user nova-compute[72992]: WARNING nova.compute.manager [req-a06ec721-6c7d-4507-80de-7cb246c7acec req-a2f03ced-a129-41cd-b168-9ebacabcd615 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received unexpected event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with vm_state active and task_state rebuilding.
Aug 15 21:20:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:32 user nova-compute[72992]: INFO nova.compute.manager [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Terminating instance
Aug 15 21:20:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-ae6da589-1265-421d-9287-4cc001cb44ab req-f3ac65c4-aa14-4ebc-8c42-91646eaa0841 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ae6da589-1265-421d-9287-4cc001cb44ab req-f3ac65c4-aa14-4ebc-8c42-91646eaa0841 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ae6da589-1265-421d-9287-4cc001cb44ab req-f3ac65c4-aa14-4ebc-8c42-91646eaa0841 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ae6da589-1265-421d-9287-4cc001cb44ab req-f3ac65c4-aa14-4ebc-8c42-91646eaa0841 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-ae6da589-1265-421d-9287-4cc001cb44ab req-f3ac65c4-aa14-4ebc-8c42-91646eaa0841 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-unplugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-ae6da589-1265-421d-9287-4cc001cb44ab req-f3ac65c4-aa14-4ebc-8c42-91646eaa0841 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-d2b77738-b77c-44cf-85d2-402c2663d723 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-unplugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-12d0e7a1-0166-465c-87c4-b0dd9525132a for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:33 user nova-compute[72992]: WARNING nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-12d0e7a1-0166-465c-87c4-b0dd9525132a for instance with vm_state active and task_state deleting.
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-unplugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:33 user nova-compute[72992]: WARNING nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d for instance with vm_state active and task_state deleting.
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-unplugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cdac5e8-d143-4c60-947d-f2774557374c req-6142400c-9810-4f62-a417-6fecef63bbfd service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-045a49a9-5c44-4b81-b37d-99316d965b65 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Instance destroyed successfully.
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.objects.instance [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lazy-loading 'resources' on Instance uuid 5b5143db-39e5-4962-a85d-fe6cd0cdb45d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "address": "fa:16:3e:5c:19:bc", "network": {"id": "9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1594590533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12d0e7a1-01", "ovs_interfaceid": "12d0e7a1-0166-465c-87c4-b0dd9525132a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:19:bc,bridge_name='br-int',has_traffic_filtering=True,id=12d0e7a1-0166-465c-87c4-b0dd9525132a,network=Network(9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d0e7a1-01') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:19:bc,bridge_name='br-int',has_traffic_filtering=True,id=12d0e7a1-0166-465c-87c4-b0dd9525132a,network=Network(9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d0e7a1-01') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12d0e7a1-01, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: INFO os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:19:bc,bridge_name='br-int',has_traffic_filtering=True,id=12d0e7a1-0166-465c-87c4-b0dd9525132a,network=Network(9cdfc0a3-b6c7-48ac-93fe-93f857b5b0b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12d0e7a1-01')
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:55:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c8ccf12-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:55:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c8ccf12-2f') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c8ccf12-2f, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: INFO os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:55:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3c8ccf12-2f')
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:08:d6,bridge_name='br-int',has_traffic_filtering=True,id=d2b77738-b77c-44cf-85d2-402c2663d723,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2b77738-b7') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:08:d6,bridge_name='br-int',has_traffic_filtering=True,id=d2b77738-b77c-44cf-85d2-402c2663d723,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2b77738-b7') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2b77738-b7, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: INFO os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:08:d6,bridge_name='br-int',has_traffic_filtering=True,id=d2b77738-b77c-44cf-85d2-402c2663d723,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2b77738-b7')
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=045a49a9-5c44-4b81-b37d-99316d965b65,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045a49a9-5c') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=045a49a9-5c44-4b81-b37d-99316d965b65,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045a49a9-5c') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap045a49a9-5c, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: INFO os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:96:bf,bridge_name='br-int',has_traffic_filtering=True,id=045a49a9-5c44-4b81-b37d-99316d965b65,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap045a49a9-5c')
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:e9:67,bridge_name='br-int',has_traffic_filtering=True,id=a4b22d64-79d0-4ead-b8e9-a055a80e4fdf,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b22d64-79') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:e9:67,bridge_name='br-int',has_traffic_filtering=True,id=a4b22d64-79d0-4ead-b8e9-a055a80e4fdf,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b22d64-79') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4b22d64-79, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: INFO os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:e9:67,bridge_name='br-int',has_traffic_filtering=True,id=a4b22d64-79d0-4ead-b8e9-a055a80e4fdf,network=Network(df739fec-d5e2-40d5-9260-a91cbe4240d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4b22d64-79')
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:56,bridge_name='br-int',has_traffic_filtering=True,id=660278b3-4b40-47e9-a1d2-5a28a6614bfb,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660278b3-4b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:56,bridge_name='br-int',has_traffic_filtering=True,id=660278b3-4b40-47e9-a1d2-5a28a6614bfb,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660278b3-4b') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap660278b3-4b, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: INFO os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ed:56,bridge_name='br-int',has_traffic_filtering=True,id=660278b3-4b40-47e9-a1d2-5a28a6614bfb,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660278b3-4b')
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T21:17:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1301252468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1301252468',id=15,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn8RL8wWheavkD1uqoZdfcf+oJ4hLRIciY3mtOnX682tq7r0omdSZPtNgblce9nGI9LRHn6OURvPHhpulExJulCGe9Ot3XVv9NqN6tILH4HEu+JP/QgEHgff5ccK8Ryww==',key_name='tempest-keypair-1728459960',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9b36c330bfb4288b96178f25e8820ef',ramdisk_id='',reservation_id='r-3ap78v3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-532422830',owner_user_name='tempest-TaggedBootDevicesTest-532422830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='908a8f34f6054d1a806d9e6dfc8ba0f7',uuid=5b5143db-39e5-4962-a85d-fe6cd0cdb45d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converting VIF {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5d:4b,bridge_name='br-int',has_traffic_filtering=True,id=ad9fc02d-ae92-408a-be5a-30857baeffb8,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9fc02d-ae') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5d:4b,bridge_name='br-int',has_traffic_filtering=True,id=ad9fc02d-ae92-408a-be5a-30857baeffb8,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9fc02d-ae') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad9fc02d-ae, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: INFO os_vif [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:5d:4b,bridge_name='br-int',has_traffic_filtering=True,id=ad9fc02d-ae92-408a-be5a-30857baeffb8,network=Network(cd27b90b-b328-4db0-884a-7e84131bb8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad9fc02d-ae')
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwBJEjxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc59149b-736d-4931-9575-52f687b52a57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7335e45c-4cd2-4abf-abb4-29d5a0a94a3e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64febf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b'): ({'sdf'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Removing single pathed devices sdf {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eff4d1-943d-49b2-8ca3-c01a2eefeb99]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[31573a25-ce3a-49d1-90d0-615bd6444df1]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Flushing IO for device /dev/sdf {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b1e3c-20b2-4a4e-9137-a2cecf7ca566]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ad7b6-413f-41b2-8a24-ab37378752f7]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd2df0-86a8-4f31-b9d9-5a5e12ff5c75]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-d2b77738-b77c-44cf-85d2-402c2663d723 for instance with vm_state active and task_state deleting.
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-unplugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING nova.compute.manager [req-eecb382e-6c87-4874-9765-223ca6351e6c req-4d63e222-6990-40ed-8a06-8b03c2b78a54 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-ad9fc02d-ae92-408a-be5a-30857baeffb8 for instance with vm_state active and task_state deleting.
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bec79bb-a390-4044-a145-83f44d692ceb]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260]
Aug 15 21:20:35 user nova-compute[72992]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b, portal: 172.16.0.220,3260] successful.
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3706ef9a-0e87-432b-b70b-675babea402b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3187ac6e-d6c2-4f72-861d-d2dfc93b5ae1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== disconnect_volume: return (311ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIQNYgCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b74b1b-5409-443b-bb4f-4b1cc976787c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcb0211-3e04-46a7-a966-1a4a51e9fa67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64febf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7'): ({'sdg'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Removing single pathed devices sdg {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: INFO nova.compute.manager [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Terminating instance
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[291bb497-c613-490d-98e8-231b3760d5f9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b541dd51-c506-4766-9c47-ebd0d9affba5]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Flushing IO for device /dev/sdg {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b08b39-5343-42b5-864c-c557edd47ae7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7748be-92ca-40fc-8873-804121af9369]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] SCSI volumes sdg have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[766eeba2-9d0e-4ac2-adfe-ecd4e82920ce]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8e515f-ad99-4e78-83b6-83d56fe3c245]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260]
Aug 15 21:20:35 user nova-compute[72992]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7, portal: 172.16.0.220,3260] successful.
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95161330-40d2-4e21-9b7b-0a32eeddd1f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64ae46-2b8a-40c7-998e-8bfd400014c2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== disconnect_volume: return (298ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vITJKodf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d246208-9f12-409c-8370-5f6de638e3a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ffd08-2cda-423e-bb9e-c9db6a79f094]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 (non-flash)
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c884ddab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2'): ({'sdh'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Removing single pathed devices sdh {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1b7cc9-b231-4fbb-817c-4ea9f805cd93]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd44b3f-22e2-4eca-9ad0-328f396b165b]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Flushing IO for device /dev/sdh {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a01d5c8-2b9e-431f-a7c3-2efacf8713f5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c009ded-d307-49c0-a13f-4948bbf64b91]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] SCSI volumes sdh have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f2f3fe-af4f-4435-aaa6-b89b6e34d8df]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5950c24-de34-4221-8d28-04c8022ec778]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260]
Aug 15 21:20:35 user nova-compute[72992]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2, portal: 172.16.0.220,3260] successful.
Aug 15 21:20:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-045a49a9-5c44-4b81-b37d-99316d965b65 for instance with vm_state active and task_state deleting.
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-unplugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf for instance with vm_state active and task_state deleting.
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-unplugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-unplugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Acquiring lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] No waiting events found dispatching network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: WARNING nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received unexpected event network-vif-plugged-660278b3-4b40-47e9-a1d2-5a28a6614bfb for instance with vm_state active and task_state deleting.
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-33a26b34-9e9a-4750-af4a-ae65d618ee2f req-20fa9905-fa76-49cd-8a73-42b97f2fc44f service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-unplugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:20:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4597718e-cb14-457b-aa34-76cea15e73c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[01821916-2939-4386-a990-c80e28158d52]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] <== disconnect_volume: return (331ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:20:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Deleting instance files /opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d_del
Aug 15 21:20:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Deletion of /opt/stack/data/nova/instances/5b5143db-39e5-4962-a85d-fe6cd0cdb45d_del complete
Aug 15 21:20:36 user nova-compute[72992]: INFO nova.compute.manager [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Took 3.42 seconds to destroy the instance on the hypervisor.
Aug 15 21:20:36 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:20:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Instance destroyed successfully.
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.objects.instance [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lazy-loading 'resources' on Instance uuid d7297eef-0545-4a9b-bc17-0cc9eed179d0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1417900130',display_name='tempest-ServerStableDeviceRescueTest-server-1417900130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1417900130',id=5,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7ZLnoh6RIZDQRKtYGj4FQkpVRjtE7bTxS4Ap5jRyYQc2IgnS4ni63NGJQvyy6bm+dswlA4+gyM44vcpTqFbp0rgfC74Q471kAJ8u5/3xy/eZsLJvq0j61FQ1uCPDo8qg==',key_name='tempest-keypair-1784868198',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b6c8e62937043e0abe3f53fd31a3dd2',ramdisk_id='',reservation_id='r-ij95wf1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-242377571',owner_user_name='tempest-ServerStableDeviceRescueTest-242377571-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:19:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ac86e414f5945118a79507ec92a9f45',uuid=d7297eef-0545-4a9b-bc17-0cc9eed179d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converting VIF {"id": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "address": "fa:16:3e:fc:74:38", "network": {"id": "9a13abe5-4b36-4572-bf0d-d02ae29a49c1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-986191182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b6c8e62937043e0abe3f53fd31a3dd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a2e316b-e6", "ovs_interfaceid": "5a2e316b-e6ab-434c-839b-5b914d72a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG os_vif [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a2e316b-e6, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:36 user nova-compute[72992]: INFO os_vif [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:74:38,bridge_name='br-int',has_traffic_filtering=True,id=5a2e316b-e6ab-434c-839b-5b914d72a5d4,network=Network(9a13abe5-4b36-4572-bf0d-d02ae29a49c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a2e316b-e6')
Aug 15 21:20:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Deleting instance files /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0_del
Aug 15 21:20:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Deletion of /opt/stack/data/nova/instances/d7297eef-0545-4a9b-bc17-0cc9eed179d0_del complete
Aug 15 21:20:36 user nova-compute[72992]: INFO nova.compute.manager [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 21:20:36 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:20:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:37 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:37 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Took 1.30 seconds to deallocate network for instance.
Aug 15 21:20:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-1e97ac09-435b-488c-9cfe-80ae23395191 req-808916d1-0cb3-489c-8c6a-c4dab76c0ef1 service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-deleted-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:37 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:20:37 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:20:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-4496afa4-ed23-40ac-9313-5a21289117ff req-8ffd1a11-c1fe-4347-bbca-bdc0a108f62b service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4496afa4-ed23-40ac-9313-5a21289117ff req-8ffd1a11-c1fe-4347-bbca-bdc0a108f62b service nova] Acquiring lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4496afa4-ed23-40ac-9313-5a21289117ff req-8ffd1a11-c1fe-4347-bbca-bdc0a108f62b service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4496afa4-ed23-40ac-9313-5a21289117ff req-8ffd1a11-c1fe-4347-bbca-bdc0a108f62b service nova] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-4496afa4-ed23-40ac-9313-5a21289117ff req-8ffd1a11-c1fe-4347-bbca-bdc0a108f62b service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] No waiting events found dispatching network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:20:38 user nova-compute[72992]: WARNING nova.compute.manager [req-4496afa4-ed23-40ac-9313-5a21289117ff req-8ffd1a11-c1fe-4347-bbca-bdc0a108f62b service nova] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Received unexpected event network-vif-plugged-5a2e316b-e6ab-434c-839b-5b914d72a5d4 for instance with vm_state deleted and task_state None.
Aug 15 21:20:38 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Deleted allocations for instance d7297eef-0545-4a9b-bc17-0cc9eed179d0
Aug 15 21:20:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-73039c94-ad92-4bda-8861-56cbc2492d4e tempest-ServerStableDeviceRescueTest-242377571 tempest-ServerStableDeviceRescueTest-242377571-project-member] Lock "d7297eef-0545-4a9b-bc17-0cc9eed179d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.712s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-deleted-12d0e7a1-0166-465c-87c4-b0dd9525132a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:39 user nova-compute[72992]: INFO nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Neutron deleted interface 12d0e7a1-0166-465c-87c4-b0dd9525132a; detaching it from the instance and deleting it from the info cache
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [{"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "045a49a9-5c44-4b81-b37d-99316d965b65", "address": "fa:16:3e:8b:96:bf", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap045a49a9-5c", "ovs_interfaceid": "045a49a9-5c44-4b81-b37d-99316d965b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Detach interface failed, port_id=12d0e7a1-0166-465c-87c4-b0dd9525132a, reason: Instance 5b5143db-39e5-4962-a85d-fe6cd0cdb45d could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-deleted-045a49a9-5c44-4b81-b37d-99316d965b65 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:39 user nova-compute[72992]: INFO nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Neutron deleted interface 045a49a9-5c44-4b81-b37d-99316d965b65; detaching it from the instance and deleting it from the info cache
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [{"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "address": "fa:16:3e:83:ed:56", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660278b3-4b", "ovs_interfaceid": "660278b3-4b40-47e9-a1d2-5a28a6614bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Detach interface failed, port_id=045a49a9-5c44-4b81-b37d-99316d965b65, reason: Instance 5b5143db-39e5-4962-a85d-fe6cd0cdb45d could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-deleted-660278b3-4b40-47e9-a1d2-5a28a6614bfb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:39 user nova-compute[72992]: INFO nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Neutron deleted interface 660278b3-4b40-47e9-a1d2-5a28a6614bfb; detaching it from the instance and deleting it from the info cache
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [{"id": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "address": "fa:16:3e:ad:55:7c", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8ccf12-2f", "ovs_interfaceid": "3c8ccf12-2f95-46a6-bd3a-c94da45c2f4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2b77738-b77c-44cf-85d2-402c2663d723", "address": "fa:16:3e:77:08:d6", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2b77738-b7", "ovs_interfaceid": "d2b77738-b77c-44cf-85d2-402c2663d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "address": "fa:16:3e:ce:e9:67", "network": {"id": "df739fec-d5e2-40d5-9260-a91cbe4240d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-790300290", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4b22d64-79", "ovs_interfaceid": "a4b22d64-79d0-4ead-b8e9-a055a80e4fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "address": "fa:16:3e:e6:5d:4b", "network": {"id": "cd27b90b-b328-4db0-884a-7e84131bb8b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-271468397", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f9b36c330bfb4288b96178f25e8820ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad9fc02d-ae", "ovs_interfaceid": "ad9fc02d-ae92-408a-be5a-30857baeffb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-11daa040-4c65-47ac-b02a-96abaab45c3f req-c5fdfd6d-9f63-4d43-8738-7b0ba2bcf53c service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Detach interface failed, port_id=660278b3-4b40-47e9-a1d2-5a28a6614bfb, reason: Instance 5b5143db-39e5-4962-a85d-fe6cd0cdb45d could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:20:40 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:20:40 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Took 4.37 seconds to deallocate network for instance.
Aug 15 21:20:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-a1ef3551-47d5-4ad1-8059-8661ebed0757 req-2cbd020b-86fd-40ea-8b58-e26ed9706123 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-deleted-a4b22d64-79d0-4ead-b8e9-a055a80e4fdf {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-a1ef3551-47d5-4ad1-8059-8661ebed0757 req-2cbd020b-86fd-40ea-8b58-e26ed9706123 service nova] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Received event network-vif-deleted-ad9fc02d-ae92-408a-be5a-30857baeffb8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:42 user nova-compute[72992]: INFO nova.compute.manager [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Took 2.18 seconds to detach 3 volumes for instance.
Aug 15 21:20:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:42 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:20:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:20:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:43 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Deleted allocations for instance 5b5143db-39e5-4962-a85d-fe6cd0cdb45d
Aug 15 21:20:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-54c53c27-7a90-4c75-86a7-b13c96fe892f tempest-TaggedBootDevicesTest-532422830 tempest-TaggedBootDevicesTest-532422830-project-member] Lock "5b5143db-39e5-4962-a85d-fe6cd0cdb45d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.455s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:45 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134430.1741266, 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:45 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] VM Stopped (Lifecycle Event)
Aug 15 21:20:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0788603f-a50a-41ec-a7fb-852081f98457 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:49 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134434.6085997, 5b5143db-39e5-4962-a85d-fe6cd0cdb45d => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:49 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] VM Stopped (Lifecycle Event)
Aug 15 21:20:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-ce02cc4c-05c4-456c-969a-3a23cd51488e None None] [instance: 5b5143db-39e5-4962-a85d-fe6cd0cdb45d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad req-e92442e6-5648-412c-bba1-a254cd4e5a6c service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event volume-reimaged-cc30a2b7-9757-4c6c-96ed-f67a203c5842 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad req-e92442e6-5648-412c-bba1-a254cd4e5a6c service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad req-e92442e6-5648-412c-bba1-a254cd4e5a6c service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad req-e92442e6-5648-412c-bba1-a254cd4e5a6c service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad req-e92442e6-5648-412c-bba1-a254cd4e5a6c service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Processing event volume-reimaged-cc30a2b7-9757-4c6c-96ed-f67a203c5842 {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:20:50 user nova-compute[72992]: INFO nova.virt.block_device [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Booting with volume cc30a2b7-9757-4c6c-96ed-f67a203c5842 at /dev/vda
Aug 15 21:20:50 user nova-compute[72992]: DEBUG os_brick.utils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1dbe92-7002-4742-8af5-327d90098078]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28ed421-9106-4953-b086-9b43abf12bc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ee3301-29da-497f-8470-9fbfa69eec2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[000956d5-273e-402a-ba6e-12ba32f2fd95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:20:50 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:20:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[348ed547-42b9-4c76-8f4f-cd44c9ea88c4]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG os_brick.utils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:20:50 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updating existing volume attachment record: 1db41377-b6ae-4331-b4f3-7f9af4946c18 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:20:51 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134436.219208, d7297eef-0545-4a9b-bc17-0cc9eed179d0 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:20:51 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] VM Stopped (Lifecycle Event)
Aug 15 21:20:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-865d6fdd-09c2-4ec6-b489-1f238338ce57 None None] [instance: d7297eef-0545-4a9b-bc17-0cc9eed179d0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:20:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:20:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Creating image(s)
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Ensure instance console log exists: /opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Start _get_guest_xml network_info=[{"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc30a2b7-9757-4c6c-96ed-f67a203c5842', 'serial': 'cc30a2b7-9757-4c6c-96ed-f67a203c5842'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '1db41377-b6ae-4331-b4f3-7f9af4946c18', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:20:59 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 21:20:59 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:20:59 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:20:59 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:20:59 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d2ac9f-06be-4c30-ab26-0a5770f5b3c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:20:59 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d3cf00-8cea-4d89-bf3b-d07b7e2f710c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842] added
Aug 15 21:20:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.094s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93238c3-8748-44ac-ad1b-570aaf1ed452]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a82f8-c30c-48a0-ab3f-f58e42eaef0a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVMmpcse {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WVMmpcse" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb3dfa1-5c75-401e-ae6e-f62e00069757]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WVMmpcse'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbb902-a03e-4c7a-9794-4673bb8725e2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b38a7e9-497d-461d-80e7-f892e2e1ea6e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:20:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdbc24b-9c60-478d-9170-98ed0732c759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]
Aug 15 21:20:59 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.
Aug 15 21:20:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:20:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be12ce-c4f6-49a0-bc31-141c56e6806a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef057fb-49db-4fff-8635-9ae3bfc9fc63]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:00 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:00 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:00 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:00 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[147203fa-9ff0-4812-838a-e5bf01329f81]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:21:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23863393762633433', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863393762633433', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-324504329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-507659784',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC4t2+nmaAs27FyCYyguyqSgAe9CAMrpZ/FJByVORIFboOrEkCb/KaQS+ZLSH86GgIZAihoJRBzqLI7XWguwj13w4o9mOJJJMwvJ4f2DudJMu1wqjsl/OIXMlY+zBy31A==',key_name='tempest-keypair-1478025030',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f14274f8917c464eb2583364aac4b207',ramdisk_id='',reservation_id='r-vd8xoz80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-717569970',owner_user_name='tempest-ServerActionsV293TestJSON-717569970-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cebffa69e7640dabdeb9783896d23a6',uuid=7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converting VIF {"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:21:01 user nova-compute[72992]:   <uuid>7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c</uuid>
Aug 15 21:21:01 user nova-compute[72992]:   <name>instance-00000011</name>
Aug 15 21:21:01 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:21:01 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:21:01 user nova-compute[72992]:   <metadata>
Aug 15 21:21:01 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:21:01 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:21:01 user nova-compute[72992]:       <nova:name>tempest-ServerActionsV293TestJSON-server-324504329</nova:name>
Aug 15 21:21:01 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:20:59</nova:creationTime>
Aug 15 21:21:01 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:21:01 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:21:01 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:21:01 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:21:01 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:21:01 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:21:01 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:21:01 user nova-compute[72992]:       <nova:owner>
Aug 15 21:21:01 user nova-compute[72992]:         <nova:user uuid="5cebffa69e7640dabdeb9783896d23a6">tempest-ServerActionsV293TestJSON-717569970-project-member</nova:user>
Aug 15 21:21:01 user nova-compute[72992]:         <nova:project uuid="f14274f8917c464eb2583364aac4b207">tempest-ServerActionsV293TestJSON-717569970</nova:project>
Aug 15 21:21:01 user nova-compute[72992]:       </nova:owner>
Aug 15 21:21:01 user nova-compute[72992]:       <nova:ports>
Aug 15 21:21:01 user nova-compute[72992]:         <nova:port uuid="fc5d6d0d-096f-4934-afe8-b7e58667def8">
Aug 15 21:21:01 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:21:01 user nova-compute[72992]:         </nova:port>
Aug 15 21:21:01 user nova-compute[72992]:       </nova:ports>
Aug 15 21:21:01 user nova-compute[72992]:     </nova:instance>
Aug 15 21:21:01 user nova-compute[72992]:   </metadata>
Aug 15 21:21:01 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:21:01 user nova-compute[72992]:     <system>
Aug 15 21:21:01 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:21:01 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:21:01 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:21:01 user nova-compute[72992]:       <entry name="serial">7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c</entry>
Aug 15 21:21:01 user nova-compute[72992]:       <entry name="uuid">7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c</entry>
Aug 15 21:21:01 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:21:01 user nova-compute[72992]:     </system>
Aug 15 21:21:01 user nova-compute[72992]:   </sysinfo>
Aug 15 21:21:01 user nova-compute[72992]:   <os>
Aug 15 21:21:01 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:21:01 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:21:01 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:21:01 user nova-compute[72992]:   </os>
Aug 15 21:21:01 user nova-compute[72992]:   <features>
Aug 15 21:21:01 user nova-compute[72992]:     <acpi/>
Aug 15 21:21:01 user nova-compute[72992]:     <apic/>
Aug 15 21:21:01 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:21:01 user nova-compute[72992]:   </features>
Aug 15 21:21:01 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:21:01 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:21:01 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:21:01 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:21:01 user nova-compute[72992]:   </clock>
Aug 15 21:21:01 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:21:01 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:21:01 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:21:01 user nova-compute[72992]:   </cpu>
Aug 15 21:21:01 user nova-compute[72992]:   <devices>
Aug 15 21:21:01 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:21:01 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:01 user nova-compute[72992]:       <source dev="/dev/sdc"/>
Aug 15 21:21:01 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:21:01 user nova-compute[72992]:       <serial>cc30a2b7-9757-4c6c-96ed-f67a203c5842</serial>
Aug 15 21:21:01 user nova-compute[72992]:     </disk>
Aug 15 21:21:01 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:21:01 user nova-compute[72992]:       <mac address="fa:16:3e:98:e1:10"/>
Aug 15 21:21:01 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:01 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:21:01 user nova-compute[72992]:       <target dev="tapfc5d6d0d-09"/>
Aug 15 21:21:01 user nova-compute[72992]:     </interface>
Aug 15 21:21:01 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:21:01 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c/console.log" append="off"/>
Aug 15 21:21:01 user nova-compute[72992]:     </serial>
Aug 15 21:21:01 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:21:01 user nova-compute[72992]:     <video>
Aug 15 21:21:01 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:01 user nova-compute[72992]:     </video>
Aug 15 21:21:01 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:21:01 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:21:01 user nova-compute[72992]:     </rng>
Aug 15 21:21:01 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:21:01 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:21:01 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:21:01 user nova-compute[72992]:     </memballoon>
Aug 15 21:21:01 user nova-compute[72992]:   </devices>
Aug 15 21:21:01 user nova-compute[72992]: </domain>
Aug 15 21:21:01 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-324504329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-507659784',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC4t2+nmaAs27FyCYyguyqSgAe9CAMrpZ/FJByVORIFboOrEkCb/KaQS+ZLSH86GgIZAihoJRBzqLI7XWguwj13w4o9mOJJJMwvJ4f2DudJMu1wqjsl/OIXMlY+zBy31A==',key_name='tempest-keypair-1478025030',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f14274f8917c464eb2583364aac4b207',ramdisk_id='',reservation_id='r-vd8xoz80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-717569970',owner_user_name='tempest-ServerActionsV293TestJSON-717569970-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cebffa69e7640dabdeb9783896d23a6',uuid=7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converting VIF {"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG os_vif [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc5d6d0d-09, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc5d6d0d-09, col_values=(('external_ids', {'iface-id': 'fc5d6d0d-096f-4934-afe8-b7e58667def8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:e1:10', 'vm-uuid': '7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:01 user nova-compute[72992]: INFO os_vif [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09')
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] No VIF found with MAC fa:16:3e:98:e1:10, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:21:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-changed-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Refreshing instance network info cache due to event network-changed-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] Acquiring lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] Acquired lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Refreshing network info cache for port 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-6fe40321-3d92-4b50-a22c-3baa5cb2353e req-523a16a9-8ef2-450f-8f60-53dc65a4f44e service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6fe40321-3d92-4b50-a22c-3baa5cb2353e req-523a16a9-8ef2-450f-8f60-53dc65a4f44e service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6fe40321-3d92-4b50-a22c-3baa5cb2353e req-523a16a9-8ef2-450f-8f60-53dc65a4f44e service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6fe40321-3d92-4b50-a22c-3baa5cb2353e req-523a16a9-8ef2-450f-8f60-53dc65a4f44e service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-6fe40321-3d92-4b50-a22c-3baa5cb2353e req-523a16a9-8ef2-450f-8f60-53dc65a4f44e service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No waiting events found dispatching network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:02 user nova-compute[72992]: WARNING nova.compute.manager [req-6fe40321-3d92-4b50-a22c-3baa5cb2353e req-523a16a9-8ef2-450f-8f60-53dc65a4f44e service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received unexpected event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 21:21:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG nova.network.neutron [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updated VIF entry in instance network info cache for port 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG nova.network.neutron [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating instance_info_cache with network_info: [{"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'flavor' on Instance uuid 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2eebc084-f86a-4d6c-8fa8-674b53b56314 req-f7db0eb4-c7c8-428a-937a-c6f87382ee41 service nova] Releasing lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:03 user nova-compute[72992]: INFO nova.compute.manager [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Attaching volume 4196b45f-6864-47dc-97a5-35b1a483337f to /dev/vdb
Aug 15 21:21:03 user nova-compute[72992]: DEBUG os_brick.utils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8176bb72-f4cd-43ed-8744-41db4f636dfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba27ad-edb0-4b01-834c-a52a4ade20de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8925b743-7bbf-49d3-b221-93d60a55ae96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43cd52f-6efb-4456-8993-77dd91ffd3c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:21:03 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:21:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d1380-39d3-4379-b904-d59e63b81b74]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG os_brick.utils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:03 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating existing volume attachment record: a1dce665-3290-4afd-bfde-6492178265bb {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134464.7169425, 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:04 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] VM Resumed (Lifecycle Event)
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:21:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance spawned successfully.
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:04 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134464.719768, 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:04 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] VM Started (Lifecycle Event)
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:04 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 21:21:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72992) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 21:21:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a2ad177b-6158-44f3-b0ad-868dc99ff9ad tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-adb6ce77-4e57-48dd-8a3a-84f4e5043a50 req-e855d6df-88c0-416c-90f8-ae212e84bb52 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-adb6ce77-4e57-48dd-8a3a-84f4e5043a50 req-e855d6df-88c0-416c-90f8-ae212e84bb52 service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-adb6ce77-4e57-48dd-8a3a-84f4e5043a50 req-e855d6df-88c0-416c-90f8-ae212e84bb52 service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-adb6ce77-4e57-48dd-8a3a-84f4e5043a50 req-e855d6df-88c0-416c-90f8-ae212e84bb52 service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-adb6ce77-4e57-48dd-8a3a-84f4e5043a50 req-e855d6df-88c0-416c-90f8-ae212e84bb52 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No waiting events found dispatching network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:05 user nova-compute[72992]: WARNING nova.compute.manager [req-adb6ce77-4e57-48dd-8a3a-84f4e5043a50 req-e855d6df-88c0-416c-90f8-ae212e84bb52 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received unexpected event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with vm_state active and task_state None.
Aug 15 21:21:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:21:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquired lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'info_cache' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating instance_info_cache with network_info: [{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Releasing lock "refresh_cache-b198f99d-1575-4ac1-9f66-47d12fda99d9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance destroyed successfully.
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'resources' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG os_vif [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:21:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b5157e-60, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:21:08 user nova-compute[72992]: INFO os_vif [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60')
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Start _get_guest_xml network_info=[{"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'numa_topology' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'vcpu_model' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'pci_devices' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Error from libvirt while getting description of instance-00000004: [Error Code 42] Domain not found: no domain with matching uuid 'b198f99d-1575-4ac1-9f66-47d12fda99d9' (instance-00000004): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b198f99d-1575-4ac1-9f66-47d12fda99d9' (instance-00000004)
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:21:08 user nova-compute[72992]:   <uuid>b198f99d-1575-4ac1-9f66-47d12fda99d9</uuid>
Aug 15 21:21:08 user nova-compute[72992]:   <name>instance-00000004</name>
Aug 15 21:21:08 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:21:08 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:21:08 user nova-compute[72992]:   <metadata>
Aug 15 21:21:08 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:21:08 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:21:08 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeTestJSON-server-552553520</nova:name>
Aug 15 21:21:08 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:21:08</nova:creationTime>
Aug 15 21:21:08 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:21:08 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:21:08 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:21:08 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:21:08 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:21:08 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:21:08 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:21:08 user nova-compute[72992]:       <nova:owner>
Aug 15 21:21:08 user nova-compute[72992]:         <nova:user uuid="c6ff1260094b492086d5ae874ed7dd0d">tempest-AttachVolumeTestJSON-2136218087-project-member</nova:user>
Aug 15 21:21:08 user nova-compute[72992]:         <nova:project uuid="b55df905a9e64949ac35075fb206991e">tempest-AttachVolumeTestJSON-2136218087</nova:project>
Aug 15 21:21:08 user nova-compute[72992]:       </nova:owner>
Aug 15 21:21:08 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:21:08 user nova-compute[72992]:       <nova:ports>
Aug 15 21:21:08 user nova-compute[72992]:         <nova:port uuid="25b5157e-6099-448c-af89-cc4477901f69">
Aug 15 21:21:08 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 21:21:08 user nova-compute[72992]:         </nova:port>
Aug 15 21:21:08 user nova-compute[72992]:       </nova:ports>
Aug 15 21:21:08 user nova-compute[72992]:     </nova:instance>
Aug 15 21:21:08 user nova-compute[72992]:   </metadata>
Aug 15 21:21:08 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:21:08 user nova-compute[72992]:     <system>
Aug 15 21:21:08 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:21:08 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:21:08 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:21:08 user nova-compute[72992]:       <entry name="serial">b198f99d-1575-4ac1-9f66-47d12fda99d9</entry>
Aug 15 21:21:08 user nova-compute[72992]:       <entry name="uuid">b198f99d-1575-4ac1-9f66-47d12fda99d9</entry>
Aug 15 21:21:08 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:21:08 user nova-compute[72992]:     </system>
Aug 15 21:21:08 user nova-compute[72992]:   </sysinfo>
Aug 15 21:21:08 user nova-compute[72992]:   <os>
Aug 15 21:21:08 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:21:08 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:21:08 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:21:08 user nova-compute[72992]:   </os>
Aug 15 21:21:08 user nova-compute[72992]:   <features>
Aug 15 21:21:08 user nova-compute[72992]:     <acpi/>
Aug 15 21:21:08 user nova-compute[72992]:     <apic/>
Aug 15 21:21:08 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:21:08 user nova-compute[72992]:   </features>
Aug 15 21:21:08 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:21:08 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:21:08 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:21:08 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:21:08 user nova-compute[72992]:   </clock>
Aug 15 21:21:08 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:21:08 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:21:08 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:21:08 user nova-compute[72992]:   </cpu>
Aug 15 21:21:08 user nova-compute[72992]:   <devices>
Aug 15 21:21:08 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:21:08 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:21:08 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk"/>
Aug 15 21:21:08 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:21:08 user nova-compute[72992]:     </disk>
Aug 15 21:21:08 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:21:08 user nova-compute[72992]:       <mac address="fa:16:3e:d7:04:4c"/>
Aug 15 21:21:08 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:08 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:21:08 user nova-compute[72992]:       <target dev="tap25b5157e-60"/>
Aug 15 21:21:08 user nova-compute[72992]:     </interface>
Aug 15 21:21:08 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:21:08 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/console.log" append="off"/>
Aug 15 21:21:08 user nova-compute[72992]:     </serial>
Aug 15 21:21:08 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:21:08 user nova-compute[72992]:     <video>
Aug 15 21:21:08 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:08 user nova-compute[72992]:     </video>
Aug 15 21:21:08 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:21:08 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:21:08 user nova-compute[72992]:     </rng>
Aug 15 21:21:08 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:21:08 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:21:08 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:21:08 user nova-compute[72992]:     </memballoon>
Aug 15 21:21:08 user nova-compute[72992]:   </devices>
Aug 15 21:21:08 user nova-compute[72992]: </domain>
Aug 15 21:21:08 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'trusted_certs' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Cannot resize image /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:21:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'migration_context' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG os_vif [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b5157e-60, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b5157e-60, col_values=(('external_ids', {'iface-id': '25b5157e-6099-448c-af89-cc4477901f69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:04:4c', 'vm-uuid': 'b198f99d-1575-4ac1-9f66-47d12fda99d9'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:21:09 user nova-compute[72992]: INFO os_vif [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60')
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134473.035416, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Resumed (Lifecycle Event)
Aug 15 21:21:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-cf4dfab4-8b21-4cf3-bcfc-3c2c556c2c80 req-d807b931-73a7-41df-887d-128e60a1a91d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cf4dfab4-8b21-4cf3-bcfc-3c2c556c2c80 req-d807b931-73a7-41df-887d-128e60a1a91d service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cf4dfab4-8b21-4cf3-bcfc-3c2c556c2c80 req-d807b931-73a7-41df-887d-128e60a1a91d service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cf4dfab4-8b21-4cf3-bcfc-3c2c556c2c80 req-d807b931-73a7-41df-887d-128e60a1a91d service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-cf4dfab4-8b21-4cf3-bcfc-3c2c556c2c80 req-d807b931-73a7-41df-887d-128e60a1a91d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:13 user nova-compute[72992]: WARNING nova.compute.manager [req-cf4dfab4-8b21-4cf3-bcfc-3c2c556c2c80 req-d807b931-73a7-41df-887d-128e60a1a91d service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state stopped and task_state powering-on.
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-373ad7ea-de62-46de-a6bc-69d650a15a39 req-d50953f0-0590-45f2-8be1-8d757722c466 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-373ad7ea-de62-46de-a6bc-69d650a15a39 req-d50953f0-0590-45f2-8be1-8d757722c466 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-373ad7ea-de62-46de-a6bc-69d650a15a39 req-d50953f0-0590-45f2-8be1-8d757722c466 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-373ad7ea-de62-46de-a6bc-69d650a15a39 req-d50953f0-0590-45f2-8be1-8d757722c466 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-373ad7ea-de62-46de-a6bc-69d650a15a39 req-d50953f0-0590-45f2-8be1-8d757722c466 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:13 user nova-compute[72992]: WARNING nova.compute.manager [req-373ad7ea-de62-46de-a6bc-69d650a15a39 req-d50953f0-0590-45f2-8be1-8d757722c466 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state stopped and task_state powering-on.
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:13 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:13 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=25.592369079589844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance rebooted successfully.
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-45bae43d-c8f8-44ad-b583-b21b51593609 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134473.0411744, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Started (Lifecycle Event)
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:21:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrINJzxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:14 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:14 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:14 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac24f680-b81d-4159-9af9-2cfda37fcc75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:21:14 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ccbc4-d490-439d-a9d2-5cb127253389]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f] added
Aug 15 21:21:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8564e411-f6c5-4c8d-bc06-a980603b12dd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea5bbf-1079-423f-9ffa-5ff70a0f865f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrINJzxP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrINJzxP" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bea25e9-659d-4cd8-ad74-5800f40ea43a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrINJzxP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ff7f2-a458-4e63-8742-b03b5f6426f4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be44edf-4d69-430d-8f44-df8716f08fd8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d9929-efc3-41e0-a966-c9c67d306d21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260]
Aug 15 21:21:14 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260] successful.
Aug 15 21:21:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1f3e20-d332-4c27-b048-308b7c8d9289]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06682c4-110b-41a5-b911-a23fdac93b6c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f (non-flash)
Aug 15 21:21:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:14 user nova-compute[72992]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f (non-flash)
Aug 15 21:21:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea6a2a-5a9e-4815-9c72-3fdbec33493f]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:21:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrINJzxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 217026e1-b750-4861-8806-f0d87eaabb45 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26562306332646436', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562306332646436', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'flavor' on Instance uuid 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:21:15 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:15 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:21:15 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:21:15 user nova-compute[72992]:   <serial>4196b45f-6864-47dc-97a5-35b1a483337f</serial>
Aug 15 21:21:15 user nova-compute[72992]: </disk>
Aug 15 21:21:15 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updating instance_info_cache with network_info: [{"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:21:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No VIF found with MAC fa:16:3e:18:71:88, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e4b945e-c498-44ed-a3fd-aceee02b77a9 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG nova.compute.manager [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-changed-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG nova.compute.manager [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Refreshing instance network info cache due to event network-changed-6db66a63-bcd4-4b52-91bf-3d800b701102. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] Acquiring lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] Acquired lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG nova.network.neutron [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Refreshing network info cache for port 6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:21:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updated VIF entry in instance network info cache for port 6db66a63-bcd4-4b52-91bf-3d800b701102. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:21:17 user nova-compute[72992]: DEBUG nova.network.neutron [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updating instance_info_cache with network_info: [{"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bbe265d3-ec64-4e5f-ac25-565903ac0285 req-e2c0c10d-0811-4dde-a4b8-013b6595f2e8 service nova] Releasing lock "refresh_cache-79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:18 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:21:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:18 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:21:18 user nova-compute[72992]: INFO nova.compute.claims [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Claim successful on node user
Aug 15 21:21:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:21:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.policy [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9192e3fb208c401190105a465161ad70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386bc7deac3d4d57ae29c8461335ca0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:21:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Creating image(s)
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "/opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "/opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk 1073741824" returned: 0 in 0.055s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Successfully created port: d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:20 user nova-compute[72992]: INFO nova.compute.manager [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Detaching volume 4196b45f-6864-47dc-97a5-35b1a483337f
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Cannot resize image /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'migration_context' on Instance uuid e0710ccf-1252-4d29-9b9c-65d0102e20c3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:20 user nova-compute[72992]: INFO nova.virt.block_device [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Attempting to driver detach volume 4196b45f-6864-47dc-97a5-35b1a483337f from mountpoint /dev/vdb
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Attempting to detach device vdb from instance 5023ba98-b30a-4362-a183-7366a52d0feb from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:21:20 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:20 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:21:20 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:21:20 user nova-compute[72992]:   <serial>4196b45f-6864-47dc-97a5-35b1a483337f</serial>
Aug 15 21:21:20 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:21:20 user nova-compute[72992]: </disk>
Aug 15 21:21:20 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:21:20 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully detached device vdb from instance 5023ba98-b30a-4362-a183-7366a52d0feb from the persistent domain config.
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5023ba98-b30a-4362-a183-7366a52d0feb from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:21:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:21:20 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:20 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:21:20 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:21:20 user nova-compute[72992]:   <serial>4196b45f-6864-47dc-97a5-35b1a483337f</serial>
Aug 15 21:21:20 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:21:20 user nova-compute[72992]: </disk>
Aug 15 21:21:20 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134481.1135433, 5023ba98-b30a-4362-a183-7366a52d0feb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:21:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully detached device vdb from instance 5023ba98-b30a-4362-a183-7366a52d0feb from the live domain config.
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrINJzxP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:21 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c587ed9-e5b8-402f-9399-62c69289a54b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fd1724-4251-439c-849b-cefbfc5e8538]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:21 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:21 user nova-compute[72992]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f (non-flash)
Aug 15 21:21:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:21 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:21 user nova-compute[72992]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f (non-flash)
Aug 15 21:21:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c1a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b698e6c-48c9-4ab2-becb-870b1b88aac7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[461a2334-7f84-44be-8f71-4c86d633d956]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecc08bd-70c1-45de-85a9-5fa8752efbe2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Successfully updated port: d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6811c3-ee7b-49bf-88be-de8c53833627]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquired lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-changed-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Refreshing instance network info cache due to event network-changed-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] Acquiring lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd9cf9c-fed6-47a8-b467-53cfb0cd39d5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[105f96f1-efab-4ec5-9ee3-f15a6b7f0aa4]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260]
Aug 15 21:21:21 user nova-compute[72992]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f, portal: 172.16.0.220,3260] successful.
Aug 15 21:21:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4196b45f-6864-47dc-97a5-35b1a483337f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7832e75-e381-423a-9761-c65ab86e3337]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] <== disconnect_volume: return (341ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Releasing lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Instance network_info: |[{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] Acquired lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Refreshing network info cache for port d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Start _get_guest_xml network_info=[{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:21:21 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:21 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1577539279',display_name='tempest-ServerActionsTestOtherA-server-1577539279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1577539279',id=21,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-vqbnsi59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=e0710ccf-1252-4d29-9b9c-65d0102e20c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:a4,bridge_name='br-int',has_traffic_filtering=True,id=d16baeb8-bc61-4b6c-ab85-fbb2ff1af049,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16baeb8-bc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'pci_devices' on Instance uuid e0710ccf-1252-4d29-9b9c-65d0102e20c3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:21:21 user nova-compute[72992]:   <uuid>e0710ccf-1252-4d29-9b9c-65d0102e20c3</uuid>
Aug 15 21:21:21 user nova-compute[72992]:   <name>instance-00000015</name>
Aug 15 21:21:21 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:21:21 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:21:21 user nova-compute[72992]:   <metadata>
Aug 15 21:21:21 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:21:21 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:21:21 user nova-compute[72992]:       <nova:name>tempest-ServerActionsTestOtherA-server-1577539279</nova:name>
Aug 15 21:21:21 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:21:21</nova:creationTime>
Aug 15 21:21:21 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:21:21 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:21:21 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:21:21 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:21:21 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:21:21 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:21:21 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:21:21 user nova-compute[72992]:       <nova:owner>
Aug 15 21:21:21 user nova-compute[72992]:         <nova:user uuid="9192e3fb208c401190105a465161ad70">tempest-ServerActionsTestOtherA-752735396-project-member</nova:user>
Aug 15 21:21:21 user nova-compute[72992]:         <nova:project uuid="386bc7deac3d4d57ae29c8461335ca0e">tempest-ServerActionsTestOtherA-752735396</nova:project>
Aug 15 21:21:21 user nova-compute[72992]:       </nova:owner>
Aug 15 21:21:21 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:21:21 user nova-compute[72992]:       <nova:ports>
Aug 15 21:21:21 user nova-compute[72992]:         <nova:port uuid="d16baeb8-bc61-4b6c-ab85-fbb2ff1af049">
Aug 15 21:21:21 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:21:21 user nova-compute[72992]:         </nova:port>
Aug 15 21:21:21 user nova-compute[72992]:       </nova:ports>
Aug 15 21:21:21 user nova-compute[72992]:     </nova:instance>
Aug 15 21:21:21 user nova-compute[72992]:   </metadata>
Aug 15 21:21:21 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:21:21 user nova-compute[72992]:     <system>
Aug 15 21:21:21 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:21:21 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:21:21 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:21:21 user nova-compute[72992]:       <entry name="serial">e0710ccf-1252-4d29-9b9c-65d0102e20c3</entry>
Aug 15 21:21:21 user nova-compute[72992]:       <entry name="uuid">e0710ccf-1252-4d29-9b9c-65d0102e20c3</entry>
Aug 15 21:21:21 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:21:21 user nova-compute[72992]:     </system>
Aug 15 21:21:21 user nova-compute[72992]:   </sysinfo>
Aug 15 21:21:21 user nova-compute[72992]:   <os>
Aug 15 21:21:21 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:21:21 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:21:21 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:21:21 user nova-compute[72992]:   </os>
Aug 15 21:21:21 user nova-compute[72992]:   <features>
Aug 15 21:21:21 user nova-compute[72992]:     <acpi/>
Aug 15 21:21:21 user nova-compute[72992]:     <apic/>
Aug 15 21:21:21 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:21:21 user nova-compute[72992]:   </features>
Aug 15 21:21:21 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:21:21 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:21:21 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:21:21 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:21:21 user nova-compute[72992]:   </clock>
Aug 15 21:21:21 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:21:21 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:21:21 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:21:21 user nova-compute[72992]:   </cpu>
Aug 15 21:21:21 user nova-compute[72992]:   <devices>
Aug 15 21:21:21 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:21:21 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:21:21 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk"/>
Aug 15 21:21:21 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:21:21 user nova-compute[72992]:     </disk>
Aug 15 21:21:21 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:21:21 user nova-compute[72992]:       <mac address="fa:16:3e:7c:e0:a4"/>
Aug 15 21:21:21 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:21 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:21:21 user nova-compute[72992]:       <target dev="tapd16baeb8-bc"/>
Aug 15 21:21:21 user nova-compute[72992]:     </interface>
Aug 15 21:21:21 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:21:21 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/console.log" append="off"/>
Aug 15 21:21:21 user nova-compute[72992]:     </serial>
Aug 15 21:21:21 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:21:21 user nova-compute[72992]:     <video>
Aug 15 21:21:21 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:21 user nova-compute[72992]:     </video>
Aug 15 21:21:21 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:21:21 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:21:21 user nova-compute[72992]:     </rng>
Aug 15 21:21:21 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:21:21 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:21:21 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:21:21 user nova-compute[72992]:     </memballoon>
Aug 15 21:21:21 user nova-compute[72992]:   </devices>
Aug 15 21:21:21 user nova-compute[72992]: </domain>
Aug 15 21:21:21 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1577539279',display_name='tempest-ServerActionsTestOtherA-server-1577539279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1577539279',id=21,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-vqbnsi59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=e0710ccf-1252-4d29-9b9c-65d0102e20c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:a4,bridge_name='br-int',has_traffic_filtering=True,id=d16baeb8-bc61-4b6c-ab85-fbb2ff1af049,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16baeb8-bc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG os_vif [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:a4,bridge_name='br-int',has_traffic_filtering=True,id=d16baeb8-bc61-4b6c-ab85-fbb2ff1af049,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16baeb8-bc') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd16baeb8-bc, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd16baeb8-bc, col_values=(('external_ids', {'iface-id': 'd16baeb8-bc61-4b6c-ab85-fbb2ff1af049', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:e0:a4', 'vm-uuid': 'e0710ccf-1252-4d29-9b9c-65d0102e20c3'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:21 user nova-compute[72992]: INFO os_vif [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:e0:a4,bridge_name='br-int',has_traffic_filtering=True,id=d16baeb8-bc61-4b6c-ab85-fbb2ff1af049,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16baeb8-bc')
Aug 15 21:21:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No VIF found with MAC fa:16:3e:7c:e0:a4, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'flavor' on Instance uuid 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG nova.network.neutron [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updated VIF entry in instance network info cache for port d16baeb8-bc61-4b6c-ab85-fbb2ff1af049. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG nova.network.neutron [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-37f7ef01-761d-41c4-a344-5cfdebba39d6 req-4955a9f5-0146-4d6a-a3d8-16d7032b111b service nova] Releasing lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-20cff891-5b83-44d8-9c94-d5d08f30251e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'flavor' on Instance uuid 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:22 user nova-compute[72992]: INFO nova.compute.manager [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Attaching volume aad4f2c2-4517-4c8a-851f-a53e063ece48 to /dev/vdb
Aug 15 21:21:22 user nova-compute[72992]: DEBUG os_brick.utils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4874f8b4-9bff-4177-ba16-3d9e87de9397]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[19768ccc-7c46-4cc0-8b75-5ecb56bacec8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa180c9c-7694-4500-b063-c4e17c27a002]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d57c8d3-275c-489a-b394-688f5e1bdad0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:21:22 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:21:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a395ec-5848-4d67-85b9-8a72befe839d]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG os_brick.utils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:22 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updating existing volume attachment record: ca255c3f-0e84-4e6a-9ea8-7d51f5dc54be {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-859d2155-76d7-4fd1-8fcb-6160b3abfa06 req-99597783-c3f8-42fe-8951-ffaa9bffd796 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-859d2155-76d7-4fd1-8fcb-6160b3abfa06 req-99597783-c3f8-42fe-8951-ffaa9bffd796 service nova] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-859d2155-76d7-4fd1-8fcb-6160b3abfa06 req-99597783-c3f8-42fe-8951-ffaa9bffd796 service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-859d2155-76d7-4fd1-8fcb-6160b3abfa06 req-99597783-c3f8-42fe-8951-ffaa9bffd796 service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-859d2155-76d7-4fd1-8fcb-6160b3abfa06 req-99597783-c3f8-42fe-8951-ffaa9bffd796 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] No waiting events found dispatching network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:23 user nova-compute[72992]: WARNING nova.compute.manager [req-859d2155-76d7-4fd1-8fcb-6160b3abfa06 req-99597783-c3f8-42fe-8951-ffaa9bffd796 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received unexpected event network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 for instance with vm_state building and task_state spawning.
Aug 15 21:21:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134485.5852208, e0710ccf-1252-4d29-9b9c-65d0102e20c3 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] VM Resumed (Lifecycle Event)
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:21:25 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Instance spawned successfully.
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134485.5913136, e0710ccf-1252-4d29-9b9c-65d0102e20c3 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] VM Started (Lifecycle Event)
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:21:25 user nova-compute[72992]: INFO nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-6a1a91e8-5f79-4bff-a12e-cbbc268ca089 req-d555801f-d732-4ce9-bcea-199ed90361ce service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6a1a91e8-5f79-4bff-a12e-cbbc268ca089 req-d555801f-d732-4ce9-bcea-199ed90361ce service nova] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6a1a91e8-5f79-4bff-a12e-cbbc268ca089 req-d555801f-d732-4ce9-bcea-199ed90361ce service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6a1a91e8-5f79-4bff-a12e-cbbc268ca089 req-d555801f-d732-4ce9-bcea-199ed90361ce service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-6a1a91e8-5f79-4bff-a12e-cbbc268ca089 req-d555801f-d732-4ce9-bcea-199ed90361ce service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] No waiting events found dispatching network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:25 user nova-compute[72992]: WARNING nova.compute.manager [req-6a1a91e8-5f79-4bff-a12e-cbbc268ca089 req-d555801f-d732-4ce9-bcea-199ed90361ce service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received unexpected event network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 for instance with vm_state building and task_state spawning.
Aug 15 21:21:25 user nova-compute[72992]: INFO nova.compute.manager [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Took 7.10 seconds to build instance.
Aug 15 21:21:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5a408a50-e6c9-43c8-8a05-83aa4816bbd1 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.220s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqDrltas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:33 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa686ecb-c3a9-4b86-a524-c7673a485998]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:21:33 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1ffdb6-9081-46c8-aae3-cfd7b428bc57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48] added
Aug 15 21:21:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d0c523-41b1-4b5c-9cfd-70b607a0d3e4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25bdb22-4fe6-4943-b23b-9cf05812c68a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqDrltas {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqDrltas" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[484c7fd1-bcfc-4f76-ba84-d9b2350a2f9f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nqDrltas'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8262296-0686-4e24-b0d2-27d05538b774]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8b1c72-46a3-4009-8fff-b92e551536f8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9386161-5f84-4d2e-a755-5fc830d20ac4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260]
Aug 15 21:21:33 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260] successful.
Aug 15 21:21:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feee41d-dcaf-49ac-91ca-0f13c5108c9c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0c16ba-2ede-4547-9554-71a8e6d981f1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 (non-flash)
Aug 15 21:21:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deaceed-f3ae-418b-8077-4169707303c1]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqDrltas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26663643331653131', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663643331653131', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'flavor' on Instance uuid 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:21:34 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:34 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:21:34 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:21:34 user nova-compute[72992]:   <serial>aad4f2c2-4517-4c8a-851f-a53e063ece48</serial>
Aug 15 21:21:34 user nova-compute[72992]: </disk>
Aug 15 21:21:34 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] No VIF found with MAC fa:16:3e:3b:f1:5b, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:21:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5cadcac2-dc18-48b0-9faa-f20ffee8e0c4 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.336s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:36 user nova-compute[72992]: INFO nova.compute.manager [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Detaching volume aad4f2c2-4517-4c8a-851f-a53e063ece48
Aug 15 21:21:36 user nova-compute[72992]: INFO nova.virt.block_device [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Attempting to driver detach volume aad4f2c2-4517-4c8a-851f-a53e063ece48 from mountpoint /dev/vdb
Aug 15 21:21:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Attempting to detach device vdb from instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:21:36 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:36 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:21:36 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:21:36 user nova-compute[72992]:   <serial>aad4f2c2-4517-4c8a-851f-a53e063ece48</serial>
Aug 15 21:21:36 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:21:36 user nova-compute[72992]: </disk>
Aug 15 21:21:36 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:21:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Successfully detached device vdb from instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 from the persistent domain config.
Aug 15 21:21:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:21:36 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:36 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:21:36 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:21:36 user nova-compute[72992]:   <serial>aad4f2c2-4517-4c8a-851f-a53e063ece48</serial>
Aug 15 21:21:36 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:21:36 user nova-compute[72992]: </disk>
Aug 15 21:21:36 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134497.021547, 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:21:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Successfully detached device vdb from instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 from the live domain config.
Aug 15 21:21:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqDrltas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:37 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6593e1f1-53ba-445b-b66f-7d62656082fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca8c693-881f-4e54-b762-dae0f6dadf24]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:37 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:37 user nova-compute[72992]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 (non-flash)
Aug 15 21:21:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:37 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:37 user nova-compute[72992]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 (non-flash)
Aug 15 21:21:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ca81781f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c62c16c-2a6d-4dc0-9317-4023e7bca142]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ce2a41-d135-4902-a795-2b6d09c5aa3d]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d64aa8-2b7b-4f91-a6c2-e5c909258f1a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[534b3c25-2f9f-4a85-a43b-c69450def64c]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b07c74-4764-4308-9801-9bdc256db56e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ccee1c-85bc-4444-bebf-e5a46f12c3ae]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260]
Aug 15 21:21:37 user nova-compute[72992]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48, portal: 172.16.0.220,3260] successful.
Aug 15 21:21:37 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aad4f2c2-4517-4c8a-851f-a53e063ece48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3577b964-2096-4f9d-a352-8e59b79af86f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] <== disconnect_volume: return (307ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:21:38 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'flavor' on Instance uuid 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a2a1e59-1dab-4255-adee-143bca5e3494 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:39 user nova-compute[72992]: INFO nova.compute.manager [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Unshelving
Aug 15 21:21:40 user nova-compute[72992]: INFO nova.virt.block_device [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Booting with volume 78d304ae-d80d-4559-a63b-97fb29ea960e at /dev/vda
Aug 15 21:21:40 user nova-compute[72992]: DEBUG os_brick.utils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489eef5-7df1-4654-9b96-2ac2ab550326]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbc4abe-68bc-4901-b716-c97a3e802308]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807ad50-b883-4c33-9fb0-c17cb96084c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f13b53e-672d-4694-91bc-5d728eec731c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:21:40 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:21:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb08b27-905f-4274-a680-37362eaa1645]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG os_brick.utils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:40 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating existing volume attachment record: 807c3230-a8a5-4e92-a3e6-745b49a23c3a {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:21:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:21:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:45 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:21:45 user nova-compute[72992]: INFO nova.compute.claims [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Claim successful on node user
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:21:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.policy [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d9bab564e134919a835eb6c932e3c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f4eadf36d411ab5f9f38ae8910e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:21:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Creating image(s)
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "/opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "/opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.219s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.257s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk 1073741824" returned: 0 in 0.159s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.422s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Successfully created port: da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Cannot resize image /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG nova.objects.instance [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lazy-loading 'migration_context' on Instance uuid 0e1af659-08bc-4097-bcb3-12c14816d6ee {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Ensure instance console log exists: /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Successfully updated port: da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "refresh_cache-0e1af659-08bc-4097-bcb3-12c14816d6ee" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquired lock "refresh_cache-0e1af659-08bc-4097-bcb3-12c14816d6ee" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received event network-changed-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Refreshing instance network info cache due to event network-changed-da94ab1c-c497-4d2e-bd6d-3030b5d905e8. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] Acquiring lock "refresh_cache-0e1af659-08bc-4097-bcb3-12c14816d6ee" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Updating instance_info_cache with network_info: [{"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Releasing lock "refresh_cache-0e1af659-08bc-4097-bcb3-12c14816d6ee" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Instance network_info: |[{"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] Acquired lock "refresh_cache-0e1af659-08bc-4097-bcb3-12c14816d6ee" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Refreshing network info cache for port da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Start _get_guest_xml network_info=[{"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:21:48 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:48 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-131090758',display_name='tempest-ServersNegativeTestJSON-server-131090758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-131090758',id=22,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='012f4eadf36d411ab5f9f38ae8910e33',ramdisk_id='',reservation_id='r-jwh0g1e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-827890923',owner_user_name='tempest-ServersNegativeTestJSON-827890923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:46Z,user_data=None,user_id='7d9bab564e134919a835eb6c932e3c7b',uuid=0e1af659-08bc-4097-bcb3-12c14816d6ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converting VIF {"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:11:d2,bridge_name='br-int',has_traffic_filtering=True,id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda94ab1c-c4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.objects.instance [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e1af659-08bc-4097-bcb3-12c14816d6ee {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:21:48 user nova-compute[72992]:   <uuid>0e1af659-08bc-4097-bcb3-12c14816d6ee</uuid>
Aug 15 21:21:48 user nova-compute[72992]:   <name>instance-00000016</name>
Aug 15 21:21:48 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:21:48 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:21:48 user nova-compute[72992]:   <metadata>
Aug 15 21:21:48 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:21:48 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:21:48 user nova-compute[72992]:       <nova:name>tempest-ServersNegativeTestJSON-server-131090758</nova:name>
Aug 15 21:21:48 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:21:48</nova:creationTime>
Aug 15 21:21:48 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:21:48 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:21:48 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:21:48 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:21:48 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:21:48 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:21:48 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:21:48 user nova-compute[72992]:       <nova:owner>
Aug 15 21:21:48 user nova-compute[72992]:         <nova:user uuid="7d9bab564e134919a835eb6c932e3c7b">tempest-ServersNegativeTestJSON-827890923-project-member</nova:user>
Aug 15 21:21:48 user nova-compute[72992]:         <nova:project uuid="012f4eadf36d411ab5f9f38ae8910e33">tempest-ServersNegativeTestJSON-827890923</nova:project>
Aug 15 21:21:48 user nova-compute[72992]:       </nova:owner>
Aug 15 21:21:48 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:21:48 user nova-compute[72992]:       <nova:ports>
Aug 15 21:21:48 user nova-compute[72992]:         <nova:port uuid="da94ab1c-c497-4d2e-bd6d-3030b5d905e8">
Aug 15 21:21:48 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 21:21:48 user nova-compute[72992]:         </nova:port>
Aug 15 21:21:48 user nova-compute[72992]:       </nova:ports>
Aug 15 21:21:48 user nova-compute[72992]:     </nova:instance>
Aug 15 21:21:48 user nova-compute[72992]:   </metadata>
Aug 15 21:21:48 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:21:48 user nova-compute[72992]:     <system>
Aug 15 21:21:48 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:21:48 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:21:48 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:21:48 user nova-compute[72992]:       <entry name="serial">0e1af659-08bc-4097-bcb3-12c14816d6ee</entry>
Aug 15 21:21:48 user nova-compute[72992]:       <entry name="uuid">0e1af659-08bc-4097-bcb3-12c14816d6ee</entry>
Aug 15 21:21:48 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:21:48 user nova-compute[72992]:     </system>
Aug 15 21:21:48 user nova-compute[72992]:   </sysinfo>
Aug 15 21:21:48 user nova-compute[72992]:   <os>
Aug 15 21:21:48 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:21:48 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:21:48 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:21:48 user nova-compute[72992]:   </os>
Aug 15 21:21:48 user nova-compute[72992]:   <features>
Aug 15 21:21:48 user nova-compute[72992]:     <acpi/>
Aug 15 21:21:48 user nova-compute[72992]:     <apic/>
Aug 15 21:21:48 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:21:48 user nova-compute[72992]:   </features>
Aug 15 21:21:48 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:21:48 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:21:48 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:21:48 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:21:48 user nova-compute[72992]:   </clock>
Aug 15 21:21:48 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:21:48 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:21:48 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:21:48 user nova-compute[72992]:   </cpu>
Aug 15 21:21:48 user nova-compute[72992]:   <devices>
Aug 15 21:21:48 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:21:48 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:21:48 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk"/>
Aug 15 21:21:48 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:21:48 user nova-compute[72992]:     </disk>
Aug 15 21:21:48 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:21:48 user nova-compute[72992]:       <mac address="fa:16:3e:e5:11:d2"/>
Aug 15 21:21:48 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:48 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:21:48 user nova-compute[72992]:       <target dev="tapda94ab1c-c4"/>
Aug 15 21:21:48 user nova-compute[72992]:     </interface>
Aug 15 21:21:48 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:21:48 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/console.log" append="off"/>
Aug 15 21:21:48 user nova-compute[72992]:     </serial>
Aug 15 21:21:48 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:21:48 user nova-compute[72992]:     <video>
Aug 15 21:21:48 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:48 user nova-compute[72992]:     </video>
Aug 15 21:21:48 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:21:48 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:21:48 user nova-compute[72992]:     </rng>
Aug 15 21:21:48 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:21:48 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:21:48 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:21:48 user nova-compute[72992]:     </memballoon>
Aug 15 21:21:48 user nova-compute[72992]:   </devices>
Aug 15 21:21:48 user nova-compute[72992]: </domain>
Aug 15 21:21:48 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-131090758',display_name='tempest-ServersNegativeTestJSON-server-131090758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-131090758',id=22,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='012f4eadf36d411ab5f9f38ae8910e33',ramdisk_id='',reservation_id='r-jwh0g1e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-827890923',owner_user_name='tempest-ServersNegativeTestJSON-827890923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:46Z,user_data=None,user_id='7d9bab564e134919a835eb6c932e3c7b',uuid=0e1af659-08bc-4097-bcb3-12c14816d6ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converting VIF {"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:11:d2,bridge_name='br-int',has_traffic_filtering=True,id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda94ab1c-c4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG os_vif [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:11:d2,bridge_name='br-int',has_traffic_filtering=True,id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda94ab1c-c4') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda94ab1c-c4, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda94ab1c-c4, col_values=(('external_ids', {'iface-id': 'da94ab1c-c497-4d2e-bd6d-3030b5d905e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:11:d2', 'vm-uuid': '0e1af659-08bc-4097-bcb3-12c14816d6ee'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:48 user nova-compute[72992]: INFO os_vif [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:11:d2,bridge_name='br-int',has_traffic_filtering=True,id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda94ab1c-c4')
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] No VIF found with MAC fa:16:3e:e5:11:d2, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:21:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Updated VIF entry in instance network info cache for port da94ab1c-c497-4d2e-bd6d-3030b5d905e8. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:21:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Updating instance_info_cache with network_info: [{"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e09c2755-9ac6-47f6-99b9-34a937281648 req-e7192dd1-ce21-48e2-9ff9-8afdf5349c82 service nova] Releasing lock "refresh_cache-0e1af659-08bc-4097-bcb3-12c14816d6ee" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:21:50 user nova-compute[72992]: INFO nova.compute.claims [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Claim successful on node user
Aug 15 21:21:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-e61ff9e7-4b3b-4449-a7a8-3df5055bc300 req-d70bee33-3ef2-4a2e-9367-ed2965d9c87e service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received event network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e61ff9e7-4b3b-4449-a7a8-3df5055bc300 req-d70bee33-3ef2-4a2e-9367-ed2965d9c87e service nova] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e61ff9e7-4b3b-4449-a7a8-3df5055bc300 req-d70bee33-3ef2-4a2e-9367-ed2965d9c87e service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e61ff9e7-4b3b-4449-a7a8-3df5055bc300 req-d70bee33-3ef2-4a2e-9367-ed2965d9c87e service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-e61ff9e7-4b3b-4449-a7a8-3df5055bc300 req-d70bee33-3ef2-4a2e-9367-ed2965d9c87e service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] No waiting events found dispatching network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:50 user nova-compute[72992]: WARNING nova.compute.manager [req-e61ff9e7-4b3b-4449-a7a8-3df5055bc300 req-d70bee33-3ef2-4a2e-9367-ed2965d9c87e service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received unexpected event network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 for instance with vm_state building and task_state spawning.
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:21:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:21:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.policy [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96dac56448a242a7817193b06d3ac23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d4659b5fec441f894388f4379fb182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:21:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Creating image(s)
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "/opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk 1073741824" returned: 0 in 0.052s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Cannot resize image /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'migration_context' on Instance uuid 18dca40c-2589-4fca-97db-5f88e88c7d09 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Ensure instance console log exists: /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Successfully created port: a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134512.36672, 0e1af659-08bc-4097-bcb3-12c14816d6ee => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:52 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] VM Resumed (Lifecycle Event)
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:21:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Instance spawned successfully.
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:52 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134512.3694968, 0e1af659-08bc-4097-bcb3-12c14816d6ee => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:52 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] VM Started (Lifecycle Event)
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:52 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:21:52 user nova-compute[72992]: INFO nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [req-7219a38a-0dfb-4402-95c4-600115fc287f req-3e3e3c14-3c82-4918-850c-c80f50291bab service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received event network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7219a38a-0dfb-4402-95c4-600115fc287f req-3e3e3c14-3c82-4918-850c-c80f50291bab service nova] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7219a38a-0dfb-4402-95c4-600115fc287f req-3e3e3c14-3c82-4918-850c-c80f50291bab service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7219a38a-0dfb-4402-95c4-600115fc287f req-3e3e3c14-3c82-4918-850c-c80f50291bab service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:52 user nova-compute[72992]: DEBUG nova.compute.manager [req-7219a38a-0dfb-4402-95c4-600115fc287f req-3e3e3c14-3c82-4918-850c-c80f50291bab service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] No waiting events found dispatching network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:52 user nova-compute[72992]: WARNING nova.compute.manager [req-7219a38a-0dfb-4402-95c4-600115fc287f req-3e3e3c14-3c82-4918-850c-c80f50291bab service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received unexpected event network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 for instance with vm_state building and task_state spawning.
Aug 15 21:21:52 user nova-compute[72992]: INFO nova.compute.manager [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Took 6.89 seconds to build instance.
Aug 15 21:21:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2feeb3b7-0476-4c11-a134-549fc544fd48 tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.092s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Successfully updated port: a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-18dca40c-2589-4fca-97db-5f88e88c7d09" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-18dca40c-2589-4fca-97db-5f88e88c7d09" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-changed-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Refreshing instance network info cache due to event network-changed-a4ca41f5-5a48-451b-906e-b59fb514873e. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] Acquiring lock "refresh_cache-18dca40c-2589-4fca-97db-5f88e88c7d09" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Updating instance_info_cache with network_info: [{"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-18dca40c-2589-4fca-97db-5f88e88c7d09" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Instance network_info: |[{"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] Acquired lock "refresh_cache-18dca40c-2589-4fca-97db-5f88e88c7d09" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.neutron [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Refreshing network info cache for port a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Start _get_guest_xml network_info=[{"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:21:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1275771730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1275771730',id=23,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-aqwjkush',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:51Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=18dca40c-2589-4fca-97db-5f88e88c7d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:70:72,bridge_name='br-int',has_traffic_filtering=True,id=a4ca41f5-5a48-451b-906e-b59fb514873e,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ca41f5-5a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'pci_devices' on Instance uuid 18dca40c-2589-4fca-97db-5f88e88c7d09 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:21:53 user nova-compute[72992]:   <uuid>18dca40c-2589-4fca-97db-5f88e88c7d09</uuid>
Aug 15 21:21:53 user nova-compute[72992]:   <name>instance-00000017</name>
Aug 15 21:21:53 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:21:53 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:21:53 user nova-compute[72992]:   <metadata>
Aug 15 21:21:53 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:21:53 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:21:53 user nova-compute[72992]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1275771730</nova:name>
Aug 15 21:21:53 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:21:53</nova:creationTime>
Aug 15 21:21:53 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:21:53 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:21:53 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:21:53 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:21:53 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:21:53 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:21:53 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:21:53 user nova-compute[72992]:       <nova:owner>
Aug 15 21:21:53 user nova-compute[72992]:         <nova:user uuid="96dac56448a242a7817193b06d3ac23f">tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member</nova:user>
Aug 15 21:21:53 user nova-compute[72992]:         <nova:project uuid="c0d4659b5fec441f894388f4379fb182">tempest-ServerBootFromVolumeStableRescueTest-47310148</nova:project>
Aug 15 21:21:53 user nova-compute[72992]:       </nova:owner>
Aug 15 21:21:53 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:21:53 user nova-compute[72992]:       <nova:ports>
Aug 15 21:21:53 user nova-compute[72992]:         <nova:port uuid="a4ca41f5-5a48-451b-906e-b59fb514873e">
Aug 15 21:21:53 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:21:53 user nova-compute[72992]:         </nova:port>
Aug 15 21:21:53 user nova-compute[72992]:       </nova:ports>
Aug 15 21:21:53 user nova-compute[72992]:     </nova:instance>
Aug 15 21:21:53 user nova-compute[72992]:   </metadata>
Aug 15 21:21:53 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:21:53 user nova-compute[72992]:     <system>
Aug 15 21:21:53 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:21:53 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:21:53 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:21:53 user nova-compute[72992]:       <entry name="serial">18dca40c-2589-4fca-97db-5f88e88c7d09</entry>
Aug 15 21:21:53 user nova-compute[72992]:       <entry name="uuid">18dca40c-2589-4fca-97db-5f88e88c7d09</entry>
Aug 15 21:21:53 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:21:53 user nova-compute[72992]:     </system>
Aug 15 21:21:53 user nova-compute[72992]:   </sysinfo>
Aug 15 21:21:53 user nova-compute[72992]:   <os>
Aug 15 21:21:53 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:21:53 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:21:53 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:21:53 user nova-compute[72992]:   </os>
Aug 15 21:21:53 user nova-compute[72992]:   <features>
Aug 15 21:21:53 user nova-compute[72992]:     <acpi/>
Aug 15 21:21:53 user nova-compute[72992]:     <apic/>
Aug 15 21:21:53 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:21:53 user nova-compute[72992]:   </features>
Aug 15 21:21:53 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:21:53 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:21:53 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:21:53 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:21:53 user nova-compute[72992]:   </clock>
Aug 15 21:21:53 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:21:53 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:21:53 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:21:53 user nova-compute[72992]:   </cpu>
Aug 15 21:21:53 user nova-compute[72992]:   <devices>
Aug 15 21:21:53 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:21:53 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:21:53 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk"/>
Aug 15 21:21:53 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:21:53 user nova-compute[72992]:     </disk>
Aug 15 21:21:53 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:21:53 user nova-compute[72992]:       <mac address="fa:16:3e:0a:70:72"/>
Aug 15 21:21:53 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:53 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:21:53 user nova-compute[72992]:       <target dev="tapa4ca41f5-5a"/>
Aug 15 21:21:53 user nova-compute[72992]:     </interface>
Aug 15 21:21:53 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:21:53 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/console.log" append="off"/>
Aug 15 21:21:53 user nova-compute[72992]:     </serial>
Aug 15 21:21:53 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:21:53 user nova-compute[72992]:     <video>
Aug 15 21:21:53 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:53 user nova-compute[72992]:     </video>
Aug 15 21:21:53 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:21:53 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:21:53 user nova-compute[72992]:     </rng>
Aug 15 21:21:53 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:21:53 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:21:53 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:21:53 user nova-compute[72992]:     </memballoon>
Aug 15 21:21:53 user nova-compute[72992]:   </devices>
Aug 15 21:21:53 user nova-compute[72992]: </domain>
Aug 15 21:21:53 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1275771730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1275771730',id=23,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-aqwjkush',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:51Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=18dca40c-2589-4fca-97db-5f88e88c7d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:70:72,bridge_name='br-int',has_traffic_filtering=True,id=a4ca41f5-5a48-451b-906e-b59fb514873e,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ca41f5-5a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG os_vif [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:70:72,bridge_name='br-int',has_traffic_filtering=True,id=a4ca41f5-5a48-451b-906e-b59fb514873e,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ca41f5-5a') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4ca41f5-5a, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4ca41f5-5a, col_values=(('external_ids', {'iface-id': 'a4ca41f5-5a48-451b-906e-b59fb514873e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:70:72', 'vm-uuid': '18dca40c-2589-4fca-97db-5f88e88c7d09'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:53 user nova-compute[72992]: INFO os_vif [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:70:72,bridge_name='br-int',has_traffic_filtering=True,id=a4ca41f5-5a48-451b-906e-b59fb514873e,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ca41f5-5a')
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No VIF found with MAC fa:16:3e:0a:70:72, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'pci_requests' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:21:53 user nova-compute[72992]: INFO nova.compute.claims [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Claim successful on node user
Aug 15 21:21:54 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:21:54 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:21:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:54 user nova-compute[72992]: INFO nova.network.neutron [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 21:21:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Updated VIF entry in instance network info cache for port a4ca41f5-5a48-451b-906e-b59fb514873e. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:21:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Updating instance_info_cache with network_info: [{"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-546507d2-d33d-4297-881c-c617c6a7f2ef req-3474457c-8773-4157-9afb-f21664e2b80e service nova] Releasing lock "refresh_cache-18dca40c-2589-4fca-97db-5f88e88c7d09" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-6331f813-f141-4c26-9530-9eb384b0ea1c req-20edc8ab-83c4-49f4-bf83-e1ffcf12c38f service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6331f813-f141-4c26-9530-9eb384b0ea1c req-20edc8ab-83c4-49f4-bf83-e1ffcf12c38f service nova] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6331f813-f141-4c26-9530-9eb384b0ea1c req-20edc8ab-83c4-49f4-bf83-e1ffcf12c38f service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6331f813-f141-4c26-9530-9eb384b0ea1c req-20edc8ab-83c4-49f4-bf83-e1ffcf12c38f service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-6331f813-f141-4c26-9530-9eb384b0ea1c req-20edc8ab-83c4-49f4-bf83-e1ffcf12c38f service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] No waiting events found dispatching network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:55 user nova-compute[72992]: WARNING nova.compute.manager [req-6331f813-f141-4c26-9530-9eb384b0ea1c req-20edc8ab-83c4-49f4-bf83-e1ffcf12c38f service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received unexpected event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e for instance with vm_state building and task_state spawning.
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-changed-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Refreshing instance network info cache due to event network-changed-81d960fd-8d18-453b-b0d8-19031c669131. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] Acquiring lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] Acquired lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Refreshing network info cache for port 81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.compute.claims [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Claim successful on node user
Aug 15 21:21:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Creating image(s)
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Ensure instance console log exists: /opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Start _get_guest_xml network_info=[{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ee81390-8064-4a06-893e-d5238e4b06bc', 'attached_at': '', 'detached_at': '', 'volume_id': '78d304ae-d80d-4559-a63b-97fb29ea960e', 'serial': '78d304ae-d80d-4559-a63b-97fb29ea960e'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '807c3230-a8a5-4e92-a3e6-745b49a23c3a', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:21:57 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:57 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:21:57 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:57 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:21:57 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de80c1a-e7e3-44e3-a30e-a44c1be2472b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:21:57 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ebbad0-341f-4194-b8df-d9405cb5ee8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e] added
Aug 15 21:21:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b517de3-3dbb-41f5-ba7a-42c175145ffa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[066c0e04-ca85-4b5c-857a-09c5ed9e941d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcegjNQA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcegjNQA" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2513f72-912c-480e-a756-c404cce83b89]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcegjNQA'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134517.516969, 18dca40c-2589-4fca-97db-5f88e88c7d09 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] VM Resumed (Lifecycle Event)
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[85605760-e849-4bcd-95bd-92593ca429c8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Instance spawned successfully.
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64424f4-4708-408c-8d85-4aa4e41711e9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[493057e1-20ee-4d85-8c1c-4aad3da6d7ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]
Aug 15 21:21:57 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.
Aug 15 21:21:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0250904-3490-422c-ae43-1e1e02ad4c1f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134517.5224094, 18dca40c-2589-4fca-97db-5f88e88c7d09 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] VM Started (Lifecycle Event)
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f50bd-e48d-4175-82db-795b7b8f5e6d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:21:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:21:57 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:21:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62722772-8b1c-4777-8d95-fc0b3cd01555]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] No waiting events found dispatching network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:21:57 user nova-compute[72992]: WARNING nova.compute.manager [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received unexpected event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e for instance with vm_state building and task_state spawning.
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing instance network info cache due to event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.network.neutron [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:21:57 user nova-compute[72992]: INFO nova.compute.manager [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Took 7.89 seconds to build instance.
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.927s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d74819d-db6b-45c3-bfda-cc58e81f59bd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.008s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:21:57 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:21:58 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Updated VIF entry in instance network info cache for port 81d960fd-8d18-453b-b0d8-19031c669131. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Updating instance_info_cache with network_info: [{"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ec671739-34cc-4f61-8207-5cfb05cda149 req-26dc748c-d236-4fa7-9597-80aa7fecedd8 service nova] Releasing lock "refresh_cache-a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:21:58 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Creating image(s)
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.policy [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08a032f1741f46ee814186f61b82aac4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664606f930f446fabae71df899c94da5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.284s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk 1073741824" returned: 0 in 0.060s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '26135636265326338', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135636265326338', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updated VIF entry in instance network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d40951-88da-4480-b6de-7016b76035c4 req-bb76c50e-1e26-415e-93b9-5d6fb25146ea service nova] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-273239992',display_name='tempest-TestShelveInstance-server-273239992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-273239992',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-172315357',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52c2b71054a944de87abfb5fad8101d1',ramdisk_id='',reservation_id='r-7jqfcmob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-526170969',owner_user_name='tempest-TestShelveInstance-526170969-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:21:40Z,user_data=None,user_id='44b6f1facf97472fb22015645ce76a82',uuid=9ee81390-8064-4a06-893e-d5238e4b06bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converting VIF {"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:21:58 user nova-compute[72992]:   <uuid>9ee81390-8064-4a06-893e-d5238e4b06bc</uuid>
Aug 15 21:21:58 user nova-compute[72992]:   <name>instance-00000010</name>
Aug 15 21:21:58 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:21:58 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:21:58 user nova-compute[72992]:   <metadata>
Aug 15 21:21:58 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:21:58 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:21:58 user nova-compute[72992]:       <nova:name>tempest-TestShelveInstance-server-273239992</nova:name>
Aug 15 21:21:58 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:21:57</nova:creationTime>
Aug 15 21:21:58 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:21:58 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:21:58 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:21:58 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:21:58 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:21:58 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:21:58 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:21:58 user nova-compute[72992]:       <nova:owner>
Aug 15 21:21:58 user nova-compute[72992]:         <nova:user uuid="44b6f1facf97472fb22015645ce76a82">tempest-TestShelveInstance-526170969-project-member</nova:user>
Aug 15 21:21:58 user nova-compute[72992]:         <nova:project uuid="52c2b71054a944de87abfb5fad8101d1">tempest-TestShelveInstance-526170969</nova:project>
Aug 15 21:21:58 user nova-compute[72992]:       </nova:owner>
Aug 15 21:21:58 user nova-compute[72992]:       <nova:ports>
Aug 15 21:21:58 user nova-compute[72992]:         <nova:port uuid="438b1af6-fce1-4c3e-a0c6-f20be618e1c3">
Aug 15 21:21:58 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:21:58 user nova-compute[72992]:         </nova:port>
Aug 15 21:21:58 user nova-compute[72992]:       </nova:ports>
Aug 15 21:21:58 user nova-compute[72992]:     </nova:instance>
Aug 15 21:21:58 user nova-compute[72992]:   </metadata>
Aug 15 21:21:58 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:21:58 user nova-compute[72992]:     <system>
Aug 15 21:21:58 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:21:58 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:21:58 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:21:58 user nova-compute[72992]:       <entry name="serial">9ee81390-8064-4a06-893e-d5238e4b06bc</entry>
Aug 15 21:21:58 user nova-compute[72992]:       <entry name="uuid">9ee81390-8064-4a06-893e-d5238e4b06bc</entry>
Aug 15 21:21:58 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:21:58 user nova-compute[72992]:     </system>
Aug 15 21:21:58 user nova-compute[72992]:   </sysinfo>
Aug 15 21:21:58 user nova-compute[72992]:   <os>
Aug 15 21:21:58 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:21:58 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:21:58 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:21:58 user nova-compute[72992]:   </os>
Aug 15 21:21:58 user nova-compute[72992]:   <features>
Aug 15 21:21:58 user nova-compute[72992]:     <acpi/>
Aug 15 21:21:58 user nova-compute[72992]:     <apic/>
Aug 15 21:21:58 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:21:58 user nova-compute[72992]:   </features>
Aug 15 21:21:58 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:21:58 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:21:58 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:21:58 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:21:58 user nova-compute[72992]:   </clock>
Aug 15 21:21:58 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:21:58 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:21:58 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:21:58 user nova-compute[72992]:   </cpu>
Aug 15 21:21:58 user nova-compute[72992]:   <devices>
Aug 15 21:21:58 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:21:58 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:21:58 user nova-compute[72992]:       <source dev="/dev/sdd"/>
Aug 15 21:21:58 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:21:58 user nova-compute[72992]:       <serial>78d304ae-d80d-4559-a63b-97fb29ea960e</serial>
Aug 15 21:21:58 user nova-compute[72992]:     </disk>
Aug 15 21:21:58 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:21:58 user nova-compute[72992]:       <mac address="fa:16:3e:ba:c7:bf"/>
Aug 15 21:21:58 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:58 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:21:58 user nova-compute[72992]:       <target dev="tap438b1af6-fc"/>
Aug 15 21:21:58 user nova-compute[72992]:     </interface>
Aug 15 21:21:58 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:21:58 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc/console.log" append="off"/>
Aug 15 21:21:58 user nova-compute[72992]:     </serial>
Aug 15 21:21:58 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:21:58 user nova-compute[72992]:     <video>
Aug 15 21:21:58 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:21:58 user nova-compute[72992]:     </video>
Aug 15 21:21:58 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:21:58 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:21:58 user nova-compute[72992]:     </rng>
Aug 15 21:21:58 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:21:58 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:21:58 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:21:58 user nova-compute[72992]:     </memballoon>
Aug 15 21:21:58 user nova-compute[72992]:   </devices>
Aug 15 21:21:58 user nova-compute[72992]: </domain>
Aug 15 21:21:58 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-273239992',display_name='tempest-TestShelveInstance-server-273239992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-273239992',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-172315357',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52c2b71054a944de87abfb5fad8101d1',ramdisk_id='',reservation_id='r-7jqfcmob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-526170969',owner_user_name='tempest-TestShelveInstance-526170969-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:21:40Z,user_data=None,user_id='44b6f1facf97472fb22015645ce76a82',uuid=9ee81390-8064-4a06-893e-d5238e4b06bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converting VIF {"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG os_vif [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap438b1af6-fc, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap438b1af6-fc, col_values=(('external_ids', {'iface-id': '438b1af6-fce1-4c3e-a0c6-f20be618e1c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:c7:bf', 'vm-uuid': '9ee81390-8064-4a06-893e-d5238e4b06bc'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:21:58 user nova-compute[72992]: INFO os_vif [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc')
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:21:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] No VIF found with MAC fa:16:3e:ba:c7:bf, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Cannot resize image /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'migration_context' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Ensure instance console log exists: /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:21:59 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Successfully created port: 7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Successfully updated port: 7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing instance network info cache due to event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] Acquiring lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance network_info: |[{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] Acquired lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Start _get_guest_xml network_info=[{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:22:00 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:00 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-95e25e90-1ac3-4524-a03f-ccee6f329a8e req-fb006849-6b3d-4a77-a034-a61f53fbbd68 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-95e25e90-1ac3-4524-a03f-ccee6f329a8e req-fb006849-6b3d-4a77-a034-a61f53fbbd68 service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-95e25e90-1ac3-4524-a03f-ccee6f329a8e req-fb006849-6b3d-4a77-a034-a61f53fbbd68 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-95e25e90-1ac3-4524-a03f-ccee6f329a8e req-fb006849-6b3d-4a77-a034-a61f53fbbd68 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-95e25e90-1ac3-4524-a03f-ccee6f329a8e req-fb006849-6b3d-4a77-a034-a61f53fbbd68 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:00 user nova-compute[72992]: WARNING nova.compute.manager [req-95e25e90-1ac3-4524-a03f-ccee6f329a8e req-fb006849-6b3d-4a77-a034-a61f53fbbd68 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received unexpected event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135965252',display_name='tempest-ServerRescueNegativeTestJSON-server-135965252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135965252',id=24,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoG7GLpTZPIOfeTNrohuB6QD35sMMlIjTG5U6PRzFh/AtDn9UGQjcGWYvJfTnSYCuFGyxwI6pFesDQzIamJCfWpCR5fIVkOuj+B9x49Vyzcj8PQs8beXHdOLu3i5X/Fnw==',key_name='tempest-keypair-218307302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-yqqqodut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a032f1741f46ee814186f61b82aac4',uuid=bf2b214b-f493-476b-bf23-7c13ffb3de87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'pci_devices' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:22:00 user nova-compute[72992]:   <uuid>bf2b214b-f493-476b-bf23-7c13ffb3de87</uuid>
Aug 15 21:22:00 user nova-compute[72992]:   <name>instance-00000018</name>
Aug 15 21:22:00 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:22:00 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:22:00 user nova-compute[72992]:   <metadata>
Aug 15 21:22:00 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:22:00 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:22:00 user nova-compute[72992]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-135965252</nova:name>
Aug 15 21:22:00 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:22:00</nova:creationTime>
Aug 15 21:22:00 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:22:00 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:22:00 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:22:00 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:22:00 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:22:00 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:22:00 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:22:00 user nova-compute[72992]:       <nova:owner>
Aug 15 21:22:00 user nova-compute[72992]:         <nova:user uuid="08a032f1741f46ee814186f61b82aac4">tempest-ServerRescueNegativeTestJSON-600517153-project-member</nova:user>
Aug 15 21:22:00 user nova-compute[72992]:         <nova:project uuid="664606f930f446fabae71df899c94da5">tempest-ServerRescueNegativeTestJSON-600517153</nova:project>
Aug 15 21:22:00 user nova-compute[72992]:       </nova:owner>
Aug 15 21:22:00 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:22:00 user nova-compute[72992]:       <nova:ports>
Aug 15 21:22:00 user nova-compute[72992]:         <nova:port uuid="7eb3b13a-2761-4a8c-97cd-1f991ef988be">
Aug 15 21:22:00 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 21:22:00 user nova-compute[72992]:         </nova:port>
Aug 15 21:22:00 user nova-compute[72992]:       </nova:ports>
Aug 15 21:22:00 user nova-compute[72992]:     </nova:instance>
Aug 15 21:22:00 user nova-compute[72992]:   </metadata>
Aug 15 21:22:00 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:22:00 user nova-compute[72992]:     <system>
Aug 15 21:22:00 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:22:00 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:22:00 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:22:00 user nova-compute[72992]:       <entry name="serial">bf2b214b-f493-476b-bf23-7c13ffb3de87</entry>
Aug 15 21:22:00 user nova-compute[72992]:       <entry name="uuid">bf2b214b-f493-476b-bf23-7c13ffb3de87</entry>
Aug 15 21:22:00 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:22:00 user nova-compute[72992]:     </system>
Aug 15 21:22:00 user nova-compute[72992]:   </sysinfo>
Aug 15 21:22:00 user nova-compute[72992]:   <os>
Aug 15 21:22:00 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:22:00 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:22:00 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:22:00 user nova-compute[72992]:   </os>
Aug 15 21:22:00 user nova-compute[72992]:   <features>
Aug 15 21:22:00 user nova-compute[72992]:     <acpi/>
Aug 15 21:22:00 user nova-compute[72992]:     <apic/>
Aug 15 21:22:00 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:22:00 user nova-compute[72992]:   </features>
Aug 15 21:22:00 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:22:00 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:22:00 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:22:00 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:22:00 user nova-compute[72992]:   </clock>
Aug 15 21:22:00 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:22:00 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:22:00 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:22:00 user nova-compute[72992]:   </cpu>
Aug 15 21:22:00 user nova-compute[72992]:   <devices>
Aug 15 21:22:00 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:22:00 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:22:00 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk"/>
Aug 15 21:22:00 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:22:00 user nova-compute[72992]:     </disk>
Aug 15 21:22:00 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:22:00 user nova-compute[72992]:       <mac address="fa:16:3e:50:ed:9e"/>
Aug 15 21:22:00 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:22:00 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:22:00 user nova-compute[72992]:       <target dev="tap7eb3b13a-27"/>
Aug 15 21:22:00 user nova-compute[72992]:     </interface>
Aug 15 21:22:00 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:22:00 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/console.log" append="off"/>
Aug 15 21:22:00 user nova-compute[72992]:     </serial>
Aug 15 21:22:00 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:22:00 user nova-compute[72992]:     <video>
Aug 15 21:22:00 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:22:00 user nova-compute[72992]:     </video>
Aug 15 21:22:00 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:22:00 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:22:00 user nova-compute[72992]:     </rng>
Aug 15 21:22:00 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:22:00 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:22:00 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:22:00 user nova-compute[72992]:     </memballoon>
Aug 15 21:22:00 user nova-compute[72992]:   </devices>
Aug 15 21:22:00 user nova-compute[72992]: </domain>
Aug 15 21:22:00 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135965252',display_name='tempest-ServerRescueNegativeTestJSON-server-135965252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135965252',id=24,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoG7GLpTZPIOfeTNrohuB6QD35sMMlIjTG5U6PRzFh/AtDn9UGQjcGWYvJfTnSYCuFGyxwI6pFesDQzIamJCfWpCR5fIVkOuj+B9x49Vyzcj8PQs8beXHdOLu3i5X/Fnw==',key_name='tempest-keypair-218307302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-yqqqodut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:21:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a032f1741f46ee814186f61b82aac4',uuid=bf2b214b-f493-476b-bf23-7c13ffb3de87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG os_vif [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eb3b13a-27, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7eb3b13a-27, col_values=(('external_ids', {'iface-id': '7eb3b13a-2761-4a8c-97cd-1f991ef988be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:ed:9e', 'vm-uuid': 'bf2b214b-f493-476b-bf23-7c13ffb3de87'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:22:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:00 user nova-compute[72992]: INFO os_vif [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27')
Aug 15 21:22:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No VIF found with MAC fa:16:3e:50:ed:9e, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG nova.network.neutron [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updated VIF entry in instance network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG nova.network.neutron [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ec044462-78eb-4af5-8935-37d3551314d8 req-f59aa0a8-ba6e-4f4d-beb3-37e280436422 service nova] Releasing lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:02 user nova-compute[72992]: INFO nova.compute.manager [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Attaching volume c7b986ce-ea1d-414a-b5b2-db06fa5d344b to /dev/vdb
Aug 15 21:22:02 user nova-compute[72992]: DEBUG os_brick.utils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a098fa-b9b9-4067-a6a8-a64264f5e10c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f603801-63d9-4ce4-9491-882d3d6f7fb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29be846-8ed1-4a7c-a898-ff6c89b59b76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2451be-56c9-4bd4-a6fd-71f6bd8e9656]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:22:02 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[59411bbd-643a-4216-9f4e-9e8d9c536545]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG os_brick.utils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Updating existing volume attachment record: c351a260-56c4-4e1d-b5ca-2a63724eee09 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:02 user nova-compute[72992]: WARNING nova.compute.manager [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received unexpected event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 21:22:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:02 user nova-compute[72992]: WARNING nova.compute.manager [req-daef53f9-d57a-496e-b4c4-069e2a321cae req-090512b3-1ebe-4bd5-9f11-bb8bebbd7b8a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state building and task_state spawning.
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134524.0516312, 9ee81390-8064-4a06-893e-d5238e4b06bc => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:04 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] VM Resumed (Lifecycle Event)
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:22:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance spawned successfully.
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:04 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134524.058616, 9ee81390-8064-4a06-893e-d5238e4b06bc => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:04 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] VM Started (Lifecycle Event)
Aug 15 21:22:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3bc4a5dd-ad59-484f-8f86-7c9adc82742e tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.188s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-4fa80eb4-4b2e-419b-bd03-02b30bdacf1b req-aeb606a1-a67f-4e7c-aa24-0c6dc8b78151 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4fa80eb4-4b2e-419b-bd03-02b30bdacf1b req-aeb606a1-a67f-4e7c-aa24-0c6dc8b78151 service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4fa80eb4-4b2e-419b-bd03-02b30bdacf1b req-aeb606a1-a67f-4e7c-aa24-0c6dc8b78151 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4fa80eb4-4b2e-419b-bd03-02b30bdacf1b req-aeb606a1-a67f-4e7c-aa24-0c6dc8b78151 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-4fa80eb4-4b2e-419b-bd03-02b30bdacf1b req-aeb606a1-a67f-4e7c-aa24-0c6dc8b78151 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:04 user nova-compute[72992]: WARNING nova.compute.manager [req-4fa80eb4-4b2e-419b-bd03-02b30bdacf1b req-aeb606a1-a67f-4e7c-aa24-0c6dc8b78151 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state building and task_state spawning.
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134525.0381305, bf2b214b-f493-476b-bf23-7c13ffb3de87 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:05 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] VM Resumed (Lifecycle Event)
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:05 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance spawned successfully.
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:05 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134525.0443842, bf2b214b-f493-476b-bf23-7c13ffb3de87 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:05 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] VM Started (Lifecycle Event)
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:05 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:22:05 user nova-compute[72992]: INFO nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 15 21:22:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:05 user nova-compute[72992]: INFO nova.compute.manager [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Took 8.34 seconds to build instance.
Aug 15 21:22:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c4f0b83-d35e-4add-a9c9-4971fc305ed3 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.469s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:22:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:22:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.377s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:22:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwupfcFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:22:13 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:22:13 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:22:13 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:22:13 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:13 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=6975MB free_disk=25.519664764404297GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5aad9c-714b-4d71-8f2c-b910846e811d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:22:13 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d35ad2-6c1c-4765-9afb-55bd7cc7d2b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b] added
Aug 15 21:22:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4650e-f437-400e-936e-657ff759a23f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc3f327-45ba-425d-af8d-9ff14e8b5045]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwupfcFe {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hwupfcFe" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d851bf-d7c0-49ac-a850-ede32c35029a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hwupfcFe'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b198f99d-1575-4ac1-9f66-47d12fda99d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 9ee81390-8064-4a06-893e-d5238e4b06bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bf2b214b-f493-476b-bf23-7c13ffb3de87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a7dcb-9dcf-4ab9-96d0-718641defafb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e542f2b8-b962-411c-a20b-cf64efad804f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:13 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:13 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:13 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:13 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:22:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2317f759-d955-48b4-9d69-431db2727596]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260]
Aug 15 21:22:14 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260] successful.
Aug 15 21:22:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f52f52-4c90-4360-9387-6d41a9c3bbe8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddb4ab4-a632-4a4f-87da-fc0e8192b158]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:14 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:14 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:14 user nova-compute[72992]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b (non-flash)
Aug 15 21:22:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:14 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:14 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:14 user nova-compute[72992]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b (non-flash)
Aug 15 21:22:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d47c7c-ca74-4aaf-950b-0359ea77cbb9]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwupfcFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:22:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.721s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26133616561333333', 'path': '/dev/sde'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133616561333333', 'path': '/dev/sde'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:22:15 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:22:15 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:22:15 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:22:15 user nova-compute[72992]:   <serial>c7b986ce-ea1d-414a-b5b2-db06fa5d344b</serial>
Aug 15 21:22:15 user nova-compute[72992]: </disk>
Aug 15 21:22:15 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No VIF found with MAC fa:16:3e:c3:f2:55, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:22:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a865caeb-0756-4f0f-8512-44a8ab8611c7 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.863s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:16 user nova-compute[72992]: INFO nova.compute.manager [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Detaching volume c7b986ce-ea1d-414a-b5b2-db06fa5d344b
Aug 15 21:22:16 user nova-compute[72992]: INFO nova.virt.block_device [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Attempting to driver detach volume c7b986ce-ea1d-414a-b5b2-db06fa5d344b from mountpoint /dev/vdb
Aug 15 21:22:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Attempting to detach device vdb from instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:22:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:22:16 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:22:16 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:22:16 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:22:16 user nova-compute[72992]:   <serial>c7b986ce-ea1d-414a-b5b2-db06fa5d344b</serial>
Aug 15 21:22:16 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:22:16 user nova-compute[72992]: </disk>
Aug 15 21:22:16 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:22:16 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully detached device vdb from instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 from the persistent domain config.
Aug 15 21:22:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:22:17 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:22:17 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:22:17 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:22:17 user nova-compute[72992]:   <serial>c7b986ce-ea1d-414a-b5b2-db06fa5d344b</serial>
Aug 15 21:22:17 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:22:17 user nova-compute[72992]: </disk>
Aug 15 21:22:17 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134537.4614503, a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:22:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully detached device vdb from instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 from the live domain config.
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hwupfcFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:22:17 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d64cf-78fa-4a4a-8cde-d1c6a366a321]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a271e6f-3bdd-41c2-adce-ad1eb4e5cc77]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:17 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:17 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:17 user nova-compute[72992]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b (non-flash)
Aug 15 21:22:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:17 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:17 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:17 user nova-compute[72992]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b (non-flash)
Aug 15 21:22:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64edb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b'): ({'sde'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Removing single pathed devices sde {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6673a9-7464-4f66-a114-735dbf3a98ee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bdd81c-1715-414e-bf35-b094221642e8]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flushing IO for device /dev/sde {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c084a61-150d-4b8b-b3c5-b7d4ccf55aa9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be001f1-fe5d-4279-bbe8-39b777f7390e]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f77da2-1ab6-4362-a079-c69136d7526c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc0087f-08b7-4d73-8169-18f8f5639d5b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260]
Aug 15 21:22:17 user nova-compute[72992]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b, portal: 172.16.0.220,3260] successful.
Aug 15 21:22:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b986ce-ea1d-414a-b5b2-db06fa5d344b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffcf78-0a0f-456a-959a-00566c0ceae1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== disconnect_volume: return (297ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:22:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:22:18 user nova-compute[72992]: DEBUG nova.objects.instance [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-351a3690-88ab-4f2b-8962-b55ecb2a0a00 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:20 user nova-compute[72992]: INFO nova.compute.manager [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] instance snapshotting
Aug 15 21:22:20 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Beginning live snapshot process
Aug 15 21:22:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:21 user nova-compute[72992]: INFO nova.compute.manager [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Terminating instance
Aug 15 21:22:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.223s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6o641o54/8a960255a1324f27861f1b468464dfc7.delta 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6o641o54/8a960255a1324f27861f1b468464dfc7.delta 1073741824" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 21:22:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-ddc6cccb-4213-4e1b-a7c0-97fdae0525a5 req-f4d5de86-2f82-4f09-8e1a-1d51a93d25ea service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-unplugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ddc6cccb-4213-4e1b-a7c0-97fdae0525a5 req-f4d5de86-2f82-4f09-8e1a-1d51a93d25ea service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ddc6cccb-4213-4e1b-a7c0-97fdae0525a5 req-f4d5de86-2f82-4f09-8e1a-1d51a93d25ea service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ddc6cccb-4213-4e1b-a7c0-97fdae0525a5 req-f4d5de86-2f82-4f09-8e1a-1d51a93d25ea service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-ddc6cccb-4213-4e1b-a7c0-97fdae0525a5 req-f4d5de86-2f82-4f09-8e1a-1d51a93d25ea service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No waiting events found dispatching network-vif-unplugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-ddc6cccb-4213-4e1b-a7c0-97fdae0525a5 req-f4d5de86-2f82-4f09-8e1a-1d51a93d25ea service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-unplugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:22:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Instance destroyed successfully.
Aug 15 21:22:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lazy-loading 'resources' on Instance uuid 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:18:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-324504329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-507659784',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCC4t2+nmaAs27FyCYyguyqSgAe9CAMrpZ/FJByVORIFboOrEkCb/KaQS+ZLSH86GgIZAihoJRBzqLI7XWguwj13w4o9mOJJJMwvJ4f2DudJMu1wqjsl/OIXMlY+zBy31A==',key_name='tempest-keypair-1478025030',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f14274f8917c464eb2583364aac4b207',ramdisk_id='',reservation_id='r-vd8xoz80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-717569970',owner_user_name='tempest-ServerActionsV293TestJSON-717569970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cebffa69e7640dabdeb9783896d23a6',uuid=7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converting VIF {"id": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "address": "fa:16:3e:98:e1:10", "network": {"id": "aa59a618-a12e-4484-ba8b-0a153d2ed3b6", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-602691011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f14274f8917c464eb2583364aac4b207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc5d6d0d-09", "ovs_interfaceid": "fc5d6d0d-096f-4934-afe8-b7e58667def8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_vif [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc5d6d0d-09, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:22:22 user nova-compute[72992]: INFO os_vif [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:e1:10,bridge_name='br-int',has_traffic_filtering=True,id=fc5d6d0d-096f-4934-afe8-b7e58667def8,network=Network(aa59a618-a12e-4484-ba8b-0a153d2ed3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc5d6d0d-09')
Aug 15 21:22:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WVMmpcse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:22:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fa7d9d-7544-468e-bd00-f9634a891cfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0dcd9d-7d75-4af3-a38c-e4d9b5e3ee5d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:22 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:22 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:22:22 user nova-compute[72992]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 (non-flash)
Aug 15 21:22:22 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:22:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64eb1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3a9dca-9c51-4b7b-a2a0-cab0ae156f6e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9c0671-fc63-4525-b185-3157a90a57f4]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:22:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1a988-c3ec-4783-bfe3-9400be8bbe63]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:22:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b859813-780c-4f7b-98bf-5583a5b04afe]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c97976-8ada-4c12-85be-e9cf8b2d58db]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6o641o54/8a960255a1324f27861f1b468464dfc7.delta /opt/stack/data/nova/instances/snapshots/tmp6o641o54/8a960255a1324f27861f1b468464dfc7 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66988e8-ce65-43b6-8b60-43a6d14da93f]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260]
Aug 15 21:22:23 user nova-compute[72992]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842, portal: 172.16.0.220,3260] successful.
Aug 15 21:22:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc30a2b7-9757-4c6c-96ed-f67a203c5842 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac00401-ec48-4675-8108-525ae01d60e3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] <== disconnect_volume: return (323ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:22:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Deleting instance files /opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c_del
Aug 15 21:22:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Deletion of /opt/stack/data/nova/instances/7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c_del complete
Aug 15 21:22:23 user nova-compute[72992]: INFO nova.compute.manager [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Took 2.08 seconds to destroy the instance on the hypervisor.
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6o641o54/8a960255a1324f27861f1b468464dfc7.delta /opt/stack/data/nova/instances/snapshots/tmp6o641o54/8a960255a1324f27861f1b468464dfc7" returned: 0 in 0.406s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Snapshot extracted, beginning image upload
Aug 15 21:22:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-7c9f4749-047a-4989-9b17-1e676ee3026a req-2c954f2f-7171-4ac4-8580-02f807d683df service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7c9f4749-047a-4989-9b17-1e676ee3026a req-2c954f2f-7171-4ac4-8580-02f807d683df service nova] Acquiring lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7c9f4749-047a-4989-9b17-1e676ee3026a req-2c954f2f-7171-4ac4-8580-02f807d683df service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7c9f4749-047a-4989-9b17-1e676ee3026a req-2c954f2f-7171-4ac4-8580-02f807d683df service nova] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-7c9f4749-047a-4989-9b17-1e676ee3026a req-2c954f2f-7171-4ac4-8580-02f807d683df service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] No waiting events found dispatching network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:23 user nova-compute[72992]: WARNING nova.compute.manager [req-7c9f4749-047a-4989-9b17-1e676ee3026a req-2c954f2f-7171-4ac4-8580-02f807d683df service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received unexpected event network-vif-plugged-fc5d6d0d-096f-4934-afe8-b7e58667def8 for instance with vm_state active and task_state deleting.
Aug 15 21:22:24 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:24 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Took 1.05 seconds to deallocate network for instance.
Aug 15 21:22:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-508e9a07-38e4-476a-ba8c-670b047c2cfd req-1558d677-5e97-42c9-a38a-945f62b6b705 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Received event network-vif-deleted-fc5d6d0d-096f-4934-afe8-b7e58667def8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:24 user nova-compute[72992]: INFO nova.compute.manager [req-508e9a07-38e4-476a-ba8c-670b047c2cfd req-1558d677-5e97-42c9-a38a-945f62b6b705 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Neutron deleted interface fc5d6d0d-096f-4934-afe8-b7e58667def8; detaching it from the instance and deleting it from the info cache
Aug 15 21:22:24 user nova-compute[72992]: DEBUG nova.network.neutron [req-508e9a07-38e4-476a-ba8c-670b047c2cfd req-1558d677-5e97-42c9-a38a-945f62b6b705 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-508e9a07-38e4-476a-ba8c-670b047c2cfd req-1558d677-5e97-42c9-a38a-945f62b6b705 service nova] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Detach interface failed, port_id=fc5d6d0d-096f-4934-afe8-b7e58667def8, reason: Instance 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:22:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Took 0.79 seconds to detach 1 volumes for instance.
Aug 15 21:22:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Deleting volume: cc30a2b7-9757-4c6c-96ed-f67a203c5842 {{(pid=72992) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 21:22:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:25 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:22:25 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:22:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:25 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Deleted allocations for instance 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c
Aug 15 21:22:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8651163b-9fbe-4133-bb19-6c36ba32612d tempest-ServerActionsV293TestJSON-717569970 tempest-ServerActionsV293TestJSON-717569970-project-member] Lock "7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.675s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Snapshot image upload complete
Aug 15 21:22:26 user nova-compute[72992]: INFO nova.compute.manager [None req-21645436-9ebf-483c-b4cc-7df6420c2a24 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Took 5.55 seconds to snapshot the instance on the hypervisor.
Aug 15 21:22:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:22:28 user nova-compute[72992]: INFO nova.compute.claims [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Claim successful on node user
Aug 15 21:22:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.655s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.155s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:22:28 user nova-compute[72992]: INFO nova.compute.claims [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Claim successful on node user
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:22:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:22:28 user nova-compute[72992]: DEBUG nova.policy [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '501fc2d9f61e4b60aaa6b9fad0ef3029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf00e7b97164c9ea0527545062823ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:22:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Creating image(s)
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "/opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "/opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk 1073741824" returned: 0 in 0.052s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.960s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Successfully created port: ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:22:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Cannot resize image /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'migration_context' on Instance uuid e4c3c4b4-960e-4273-b237-97c9c2c86fde {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Ensure instance console log exists: /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:30 user nova-compute[72992]: DEBUG nova.policy [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9781f9aa2f141d8a96849d4c90dd553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3407b4e631e745479767ab32173a57f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:22:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:22:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:22:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Creating image(s)
Aug 15 21:22:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "/opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "/opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "c3922a97e650e675ddbe1b595eb3f692d1b58e26" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "c3922a97e650e675ddbe1b595eb3f692d1b58e26" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.part --force-share --output=json" returned: 0 in 0.242s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG nova.virt.images [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] df8a5392-5f70-402a-a85b-33c85532b112 was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.part /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.part /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.converted" returned: 0 in 0.264s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Successfully updated port: ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "refresh_cache-e4c3c4b4-960e-4273-b237-97c9c2c86fde" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquired lock "refresh_cache-e4c3c4b4-960e-4273-b237-97c9c2c86fde" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received event network-changed-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Refreshing instance network info cache due to event network-changed-ea02e54b-436c-4475-8102-08d38c803ef2. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] Acquiring lock "refresh_cache-e4c3c4b4-960e-4273-b237-97c9c2c86fde" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "c3922a97e650e675ddbe1b595eb3f692d1b58e26" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.695s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26 --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "c3922a97e650e675ddbe1b595eb3f692d1b58e26" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "c3922a97e650e675ddbe1b595eb3f692d1b58e26" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26 --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26,backing_fmt=raw /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26,backing_fmt=raw /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk 1073741824" returned: 0 in 0.059s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "c3922a97e650e675ddbe1b595eb3f692d1b58e26" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Updating instance_info_cache with network_info: [{"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.network.neutron [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Successfully created port: cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Releasing lock "refresh_cache-e4c3c4b4-960e-4273-b237-97c9c2c86fde" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Instance network_info: |[{"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] Acquired lock "refresh_cache-e4c3c4b4-960e-4273-b237-97c9c2c86fde" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.network.neutron [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Refreshing network info cache for port ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Start _get_guest_xml network_info=[{"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:22:32 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:32 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26 --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.objects.instance [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'migration_context' on Instance uuid fc8f7c53-16f3-4ebb-9382-cfd6f5601897 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1061586829',display_name='tempest-VolumesAdminNegativeTest-server-1061586829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1061586829',id=25,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf00e7b97164c9ea0527545062823ca',ramdisk_id='',reservation_id='r-51d8neiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1128814075',owner_user_name='tempest-VolumesAdminNegativeTest-1128814075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:22:29Z,user_data=None,user_id='501fc2d9f61e4b60aaa6b9fad0ef3029',uuid=e4c3c4b4-960e-4273-b237-97c9c2c86fde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converting VIF {"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea02e54b-436c-4475-8102-08d38c803ef2,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02e54b-43') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'pci_devices' on Instance uuid e4c3c4b4-960e-4273-b237-97c9c2c86fde {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Ensure instance console log exists: /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:22:32 user nova-compute[72992]:   <uuid>e4c3c4b4-960e-4273-b237-97c9c2c86fde</uuid>
Aug 15 21:22:32 user nova-compute[72992]:   <name>instance-00000019</name>
Aug 15 21:22:32 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:22:32 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:22:32 user nova-compute[72992]:   <metadata>
Aug 15 21:22:32 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:22:32 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:22:32 user nova-compute[72992]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1061586829</nova:name>
Aug 15 21:22:32 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:22:32</nova:creationTime>
Aug 15 21:22:32 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:22:32 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:22:32 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:22:32 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:22:32 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:22:32 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:22:32 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:22:32 user nova-compute[72992]:       <nova:owner>
Aug 15 21:22:32 user nova-compute[72992]:         <nova:user uuid="501fc2d9f61e4b60aaa6b9fad0ef3029">tempest-VolumesAdminNegativeTest-1128814075-project-member</nova:user>
Aug 15 21:22:32 user nova-compute[72992]:         <nova:project uuid="0cf00e7b97164c9ea0527545062823ca">tempest-VolumesAdminNegativeTest-1128814075</nova:project>
Aug 15 21:22:32 user nova-compute[72992]:       </nova:owner>
Aug 15 21:22:32 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:22:32 user nova-compute[72992]:       <nova:ports>
Aug 15 21:22:32 user nova-compute[72992]:         <nova:port uuid="ea02e54b-436c-4475-8102-08d38c803ef2">
Aug 15 21:22:32 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:22:32 user nova-compute[72992]:         </nova:port>
Aug 15 21:22:32 user nova-compute[72992]:       </nova:ports>
Aug 15 21:22:32 user nova-compute[72992]:     </nova:instance>
Aug 15 21:22:32 user nova-compute[72992]:   </metadata>
Aug 15 21:22:32 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:22:32 user nova-compute[72992]:     <system>
Aug 15 21:22:32 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:22:32 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:22:32 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:22:32 user nova-compute[72992]:       <entry name="serial">e4c3c4b4-960e-4273-b237-97c9c2c86fde</entry>
Aug 15 21:22:32 user nova-compute[72992]:       <entry name="uuid">e4c3c4b4-960e-4273-b237-97c9c2c86fde</entry>
Aug 15 21:22:32 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:22:32 user nova-compute[72992]:     </system>
Aug 15 21:22:32 user nova-compute[72992]:   </sysinfo>
Aug 15 21:22:32 user nova-compute[72992]:   <os>
Aug 15 21:22:32 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:22:32 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:22:32 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:22:32 user nova-compute[72992]:   </os>
Aug 15 21:22:32 user nova-compute[72992]:   <features>
Aug 15 21:22:32 user nova-compute[72992]:     <acpi/>
Aug 15 21:22:32 user nova-compute[72992]:     <apic/>
Aug 15 21:22:32 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:22:32 user nova-compute[72992]:   </features>
Aug 15 21:22:32 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:22:32 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:22:32 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:22:32 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:22:32 user nova-compute[72992]:   </clock>
Aug 15 21:22:32 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:22:32 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:22:32 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:22:32 user nova-compute[72992]:   </cpu>
Aug 15 21:22:32 user nova-compute[72992]:   <devices>
Aug 15 21:22:32 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:22:32 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:22:32 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk"/>
Aug 15 21:22:32 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:22:32 user nova-compute[72992]:     </disk>
Aug 15 21:22:32 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:22:32 user nova-compute[72992]:       <mac address="fa:16:3e:4c:54:7a"/>
Aug 15 21:22:32 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:22:32 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:22:32 user nova-compute[72992]:       <target dev="tapea02e54b-43"/>
Aug 15 21:22:32 user nova-compute[72992]:     </interface>
Aug 15 21:22:32 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:22:32 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/console.log" append="off"/>
Aug 15 21:22:32 user nova-compute[72992]:     </serial>
Aug 15 21:22:32 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:22:32 user nova-compute[72992]:     <video>
Aug 15 21:22:32 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:22:32 user nova-compute[72992]:     </video>
Aug 15 21:22:32 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:22:32 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:22:32 user nova-compute[72992]:     </rng>
Aug 15 21:22:32 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:22:32 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:22:32 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:22:32 user nova-compute[72992]:     </memballoon>
Aug 15 21:22:32 user nova-compute[72992]:   </devices>
Aug 15 21:22:32 user nova-compute[72992]: </domain>
Aug 15 21:22:32 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1061586829',display_name='tempest-VolumesAdminNegativeTest-server-1061586829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1061586829',id=25,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cf00e7b97164c9ea0527545062823ca',ramdisk_id='',reservation_id='r-51d8neiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1128814075',owner_user_name='tempest-VolumesAdminNegativeTest-1128814075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:22:29Z,user_data=None,user_id='501fc2d9f61e4b60aaa6b9fad0ef3029',uuid=e4c3c4b4-960e-4273-b237-97c9c2c86fde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converting VIF {"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea02e54b-436c-4475-8102-08d38c803ef2,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02e54b-43') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG os_vif [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea02e54b-436c-4475-8102-08d38c803ef2,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02e54b-43') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea02e54b-43, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea02e54b-43, col_values=(('external_ids', {'iface-id': 'ea02e54b-436c-4475-8102-08d38c803ef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:54:7a', 'vm-uuid': 'e4c3c4b4-960e-4273-b237-97c9c2c86fde'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:32 user nova-compute[72992]: INFO os_vif [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea02e54b-436c-4475-8102-08d38c803ef2,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02e54b-43')
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:22:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] No VIF found with MAC fa:16:3e:4c:54:7a, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Updated VIF entry in instance network info cache for port ea02e54b-436c-4475-8102-08d38c803ef2. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Updating instance_info_cache with network_info: [{"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-169b2d1e-43d3-4e91-8ec2-c7662551ed17 req-61bdd1a5-1288-486a-8d79-11a4a8594280 service nova] Releasing lock "refresh_cache-e4c3c4b4-960e-4273-b237-97c9c2c86fde" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.neutron [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Successfully updated port: cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquired lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.neutron [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.neutron [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-changed-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Refreshing instance network info cache due to event network-changed-cd332ff7-c934-4172-89cd-4480d3fc5c17. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] Acquiring lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.neutron [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updating instance_info_cache with network_info: [{"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Releasing lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Instance network_info: |[{"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] Acquired lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Refreshing network info cache for port cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Start _get_guest_xml network_info=[{"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bc0b40d49af3975cd4ba6801a6724b41',container_format='bare',created_at=2023-08-15T21:22:20Z,direct_url=<?>,disk_format='qcow2',id=df8a5392-5f70-402a-a85b-33c85532b112,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-835729918',owner='3407b4e631e745479767ab32173a57f9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T21:22:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'df8a5392-5f70-402a-a85b-33c85532b112'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:22:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bc0b40d49af3975cd4ba6801a6724b41',container_format='bare',created_at=2023-08-15T21:22:20Z,direct_url=<?>,disk_format='qcow2',id=df8a5392-5f70-402a-a85b-33c85532b112,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-835729918',owner='3407b4e631e745479767ab32173a57f9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T21:22:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-424204253',display_name='tempest-TestStampPattern-server-424204253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-424204253',id=26,image_ref='df8a5392-5f70-402a-a85b-33c85532b112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ9LQPzLnABcv71N9nYVWL+Fn/RdNmnzmuhnw6hO4OzBLkxgpbGKUob3hEumkbgp7aK0Sa2W4LWJ91yJuRehLK1Oo45fCKFQi/ADJDWYyb1i99bkbDTJmf0wrBW4+wheg==',key_name='tempest-TestStampPattern-46122809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3407b4e631e745479767ab32173a57f9',ramdisk_id='',reservation_id='r-gpsp9x4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5023ba98-b30a-4362-a183-7366a52d0feb',image_min_disk='1',image_min_ram='0',image_owner_id='3407b4e631e745479767ab32173a57f9',image_owner_project_name='tempest-TestStampPattern-2084179488',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2084179488-project-member',image_user_id='f9781f9aa2f141d8a96849d4c90dd553',network_allocated='True',owner_project_name='tempest-TestStampPattern-2084179488',owner_user_name='tempest-TestStampPattern-2084179488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:22:30Z,user_data=None,user_id='f9781f9aa2f141d8a96849d4c90dd553',uuid=fc8f7c53-16f3-4ebb-9382-cfd6f5601897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converting VIF {"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ba:7a,bridge_name='br-int',has_traffic_filtering=True,id=cd332ff7-c934-4172-89cd-4480d3fc5c17,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd332ff7-c9') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'pci_devices' on Instance uuid fc8f7c53-16f3-4ebb-9382-cfd6f5601897 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:22:33 user nova-compute[72992]:   <uuid>fc8f7c53-16f3-4ebb-9382-cfd6f5601897</uuid>
Aug 15 21:22:33 user nova-compute[72992]:   <name>instance-0000001a</name>
Aug 15 21:22:33 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:22:33 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:22:33 user nova-compute[72992]:   <metadata>
Aug 15 21:22:33 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:22:33 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:22:33 user nova-compute[72992]:       <nova:name>tempest-TestStampPattern-server-424204253</nova:name>
Aug 15 21:22:33 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:22:33</nova:creationTime>
Aug 15 21:22:33 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:22:33 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:22:33 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:22:33 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:22:33 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:22:33 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:22:33 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:22:33 user nova-compute[72992]:       <nova:owner>
Aug 15 21:22:33 user nova-compute[72992]:         <nova:user uuid="f9781f9aa2f141d8a96849d4c90dd553">tempest-TestStampPattern-2084179488-project-member</nova:user>
Aug 15 21:22:33 user nova-compute[72992]:         <nova:project uuid="3407b4e631e745479767ab32173a57f9">tempest-TestStampPattern-2084179488</nova:project>
Aug 15 21:22:33 user nova-compute[72992]:       </nova:owner>
Aug 15 21:22:33 user nova-compute[72992]:       <nova:root type="image" uuid="df8a5392-5f70-402a-a85b-33c85532b112"/>
Aug 15 21:22:33 user nova-compute[72992]:       <nova:ports>
Aug 15 21:22:33 user nova-compute[72992]:         <nova:port uuid="cd332ff7-c934-4172-89cd-4480d3fc5c17">
Aug 15 21:22:33 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:22:33 user nova-compute[72992]:         </nova:port>
Aug 15 21:22:33 user nova-compute[72992]:       </nova:ports>
Aug 15 21:22:33 user nova-compute[72992]:     </nova:instance>
Aug 15 21:22:33 user nova-compute[72992]:   </metadata>
Aug 15 21:22:33 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:22:33 user nova-compute[72992]:     <system>
Aug 15 21:22:33 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:22:33 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:22:33 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:22:33 user nova-compute[72992]:       <entry name="serial">fc8f7c53-16f3-4ebb-9382-cfd6f5601897</entry>
Aug 15 21:22:33 user nova-compute[72992]:       <entry name="uuid">fc8f7c53-16f3-4ebb-9382-cfd6f5601897</entry>
Aug 15 21:22:33 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:22:33 user nova-compute[72992]:     </system>
Aug 15 21:22:33 user nova-compute[72992]:   </sysinfo>
Aug 15 21:22:33 user nova-compute[72992]:   <os>
Aug 15 21:22:33 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:22:33 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:22:33 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:22:33 user nova-compute[72992]:   </os>
Aug 15 21:22:33 user nova-compute[72992]:   <features>
Aug 15 21:22:33 user nova-compute[72992]:     <acpi/>
Aug 15 21:22:33 user nova-compute[72992]:     <apic/>
Aug 15 21:22:33 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:22:33 user nova-compute[72992]:   </features>
Aug 15 21:22:33 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:22:33 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:22:33 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:22:33 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:22:33 user nova-compute[72992]:   </clock>
Aug 15 21:22:33 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:22:33 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:22:33 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:22:33 user nova-compute[72992]:   </cpu>
Aug 15 21:22:33 user nova-compute[72992]:   <devices>
Aug 15 21:22:33 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:22:33 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:22:33 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk"/>
Aug 15 21:22:33 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:22:33 user nova-compute[72992]:     </disk>
Aug 15 21:22:33 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:22:33 user nova-compute[72992]:       <mac address="fa:16:3e:e7:ba:7a"/>
Aug 15 21:22:33 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:22:33 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:22:33 user nova-compute[72992]:       <target dev="tapcd332ff7-c9"/>
Aug 15 21:22:33 user nova-compute[72992]:     </interface>
Aug 15 21:22:33 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:22:33 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/console.log" append="off"/>
Aug 15 21:22:33 user nova-compute[72992]:     </serial>
Aug 15 21:22:33 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:22:33 user nova-compute[72992]:     <video>
Aug 15 21:22:33 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:22:33 user nova-compute[72992]:     </video>
Aug 15 21:22:33 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:22:33 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:22:33 user nova-compute[72992]:     </rng>
Aug 15 21:22:33 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:22:33 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:22:33 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:22:33 user nova-compute[72992]:     </memballoon>
Aug 15 21:22:33 user nova-compute[72992]:   </devices>
Aug 15 21:22:33 user nova-compute[72992]: </domain>
Aug 15 21:22:33 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-424204253',display_name='tempest-TestStampPattern-server-424204253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-424204253',id=26,image_ref='df8a5392-5f70-402a-a85b-33c85532b112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ9LQPzLnABcv71N9nYVWL+Fn/RdNmnzmuhnw6hO4OzBLkxgpbGKUob3hEumkbgp7aK0Sa2W4LWJ91yJuRehLK1Oo45fCKFQi/ADJDWYyb1i99bkbDTJmf0wrBW4+wheg==',key_name='tempest-TestStampPattern-46122809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3407b4e631e745479767ab32173a57f9',ramdisk_id='',reservation_id='r-gpsp9x4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5023ba98-b30a-4362-a183-7366a52d0feb',image_min_disk='1',image_min_ram='0',image_owner_id='3407b4e631e745479767ab32173a57f9',image_owner_project_name='tempest-TestStampPattern-2084179488',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2084179488-project-member',image_user_id='f9781f9aa2f141d8a96849d4c90dd553',network_allocated='True',owner_project_name='tempest-TestStampPattern-2084179488',owner_user_name='tempest-TestStampPattern-2084179488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:22:30Z,user_data=None,user_id='f9781f9aa2f141d8a96849d4c90dd553',uuid=fc8f7c53-16f3-4ebb-9382-cfd6f5601897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converting VIF {"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ba:7a,bridge_name='br-int',has_traffic_filtering=True,id=cd332ff7-c934-4172-89cd-4480d3fc5c17,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd332ff7-c9') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG os_vif [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ba:7a,bridge_name='br-int',has_traffic_filtering=True,id=cd332ff7-c934-4172-89cd-4480d3fc5c17,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd332ff7-c9') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd332ff7-c9, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd332ff7-c9, col_values=(('external_ids', {'iface-id': 'cd332ff7-c934-4172-89cd-4480d3fc5c17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:ba:7a', 'vm-uuid': 'fc8f7c53-16f3-4ebb-9382-cfd6f5601897'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:22:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:33 user nova-compute[72992]: INFO os_vif [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:ba:7a,bridge_name='br-int',has_traffic_filtering=True,id=cd332ff7-c934-4172-89cd-4480d3fc5c17,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd332ff7-c9')
Aug 15 21:22:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No VIF found with MAC fa:16:3e:e7:ba:7a, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-c572ac9f-2f28-499f-81ba-3760b798fe6c req-06d60ece-84f3-4ed8-abd5-d91fa5d39cb1 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received event network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c572ac9f-2f28-499f-81ba-3760b798fe6c req-06d60ece-84f3-4ed8-abd5-d91fa5d39cb1 service nova] Acquiring lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c572ac9f-2f28-499f-81ba-3760b798fe6c req-06d60ece-84f3-4ed8-abd5-d91fa5d39cb1 service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c572ac9f-2f28-499f-81ba-3760b798fe6c req-06d60ece-84f3-4ed8-abd5-d91fa5d39cb1 service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-c572ac9f-2f28-499f-81ba-3760b798fe6c req-06d60ece-84f3-4ed8-abd5-d91fa5d39cb1 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] No waiting events found dispatching network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:34 user nova-compute[72992]: WARNING nova.compute.manager [req-c572ac9f-2f28-499f-81ba-3760b798fe6c req-06d60ece-84f3-4ed8-abd5-d91fa5d39cb1 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received unexpected event network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 for instance with vm_state building and task_state spawning.
Aug 15 21:22:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG nova.network.neutron [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updated VIF entry in instance network info cache for port cd332ff7-c934-4172-89cd-4480d3fc5c17. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG nova.network.neutron [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updating instance_info_cache with network_info: [{"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:22:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-50b35018-474c-40ed-aa27-eac8688f9cbf req-43d5131a-30c6-41e6-82f2-a4d503053227 service nova] Releasing lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:22:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-72e1f79d-6cbe-4f35-b667-8f25160a209c req-6c25a74a-cc7f-4082-a051-94d2d89cdf25 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72e1f79d-6cbe-4f35-b667-8f25160a209c req-6c25a74a-cc7f-4082-a051-94d2d89cdf25 service nova] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72e1f79d-6cbe-4f35-b667-8f25160a209c req-6c25a74a-cc7f-4082-a051-94d2d89cdf25 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72e1f79d-6cbe-4f35-b667-8f25160a209c req-6c25a74a-cc7f-4082-a051-94d2d89cdf25 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-72e1f79d-6cbe-4f35-b667-8f25160a209c req-6c25a74a-cc7f-4082-a051-94d2d89cdf25 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] No waiting events found dispatching network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:36 user nova-compute[72992]: WARNING nova.compute.manager [req-72e1f79d-6cbe-4f35-b667-8f25160a209c req-6c25a74a-cc7f-4082-a051-94d2d89cdf25 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received unexpected event network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 for instance with vm_state building and task_state spawning.
Aug 15 21:22:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-613a332c-aa78-4ec6-b9c0-5c7a788d2b73 req-b7b92845-7b52-40e4-a72d-ca57ec1dc899 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received event network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-613a332c-aa78-4ec6-b9c0-5c7a788d2b73 req-b7b92845-7b52-40e4-a72d-ca57ec1dc899 service nova] Acquiring lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-613a332c-aa78-4ec6-b9c0-5c7a788d2b73 req-b7b92845-7b52-40e4-a72d-ca57ec1dc899 service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-613a332c-aa78-4ec6-b9c0-5c7a788d2b73 req-b7b92845-7b52-40e4-a72d-ca57ec1dc899 service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-613a332c-aa78-4ec6-b9c0-5c7a788d2b73 req-b7b92845-7b52-40e4-a72d-ca57ec1dc899 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] No waiting events found dispatching network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:36 user nova-compute[72992]: WARNING nova.compute.manager [req-613a332c-aa78-4ec6-b9c0-5c7a788d2b73 req-b7b92845-7b52-40e4-a72d-ca57ec1dc899 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received unexpected event network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 for instance with vm_state building and task_state spawning.
Aug 15 21:22:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134542.7523851, 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:37 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] VM Stopped (Lifecycle Event)
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5ff5cb85-52bb-40c0-a566-1d912ba44bf1 None None] [instance: 7c4ab45f-a1ae-466d-9f63-a4ce99c3a29c] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134557.8230174, e4c3c4b4-960e-4273-b237-97c9c2c86fde => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] VM Resumed (Lifecycle Event)
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:22:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Instance spawned successfully.
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134557.823216, e4c3c4b4-960e-4273-b237-97c9c2c86fde => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] VM Started (Lifecycle Event)
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:37 user nova-compute[72992]: INFO nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Took 8.92 seconds to spawn the instance on the hypervisor.
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:37 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.compute.manager [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Took 10.01 seconds to build instance.
Aug 15 21:22:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0c25a9b5-8706-449f-bb28-563ce39618dc tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.131s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134558.3553045, fc8f7c53-16f3-4ebb-9382-cfd6f5601897 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] VM Resumed (Lifecycle Event)
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Instance spawned successfully.
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134558.3680391, fc8f7c53-16f3-4ebb-9382-cfd6f5601897 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] VM Started (Lifecycle Event)
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-de2daa7c-785e-4cfa-9845-f9054923314b req-08b2c58c-fee2-48c0-80b5-13e60f970025 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de2daa7c-785e-4cfa-9845-f9054923314b req-08b2c58c-fee2-48c0-80b5-13e60f970025 service nova] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de2daa7c-785e-4cfa-9845-f9054923314b req-08b2c58c-fee2-48c0-80b5-13e60f970025 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de2daa7c-785e-4cfa-9845-f9054923314b req-08b2c58c-fee2-48c0-80b5-13e60f970025 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-de2daa7c-785e-4cfa-9845-f9054923314b req-08b2c58c-fee2-48c0-80b5-13e60f970025 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] No waiting events found dispatching network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:38 user nova-compute[72992]: WARNING nova.compute.manager [req-de2daa7c-785e-4cfa-9845-f9054923314b req-08b2c58c-fee2-48c0-80b5-13e60f970025 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received unexpected event network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 for instance with vm_state building and task_state spawning.
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Took 8.44 seconds to spawn the instance on the hypervisor.
Aug 15 21:22:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:22:38 user nova-compute[72992]: INFO nova.compute.manager [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Took 10.04 seconds to build instance.
Aug 15 21:22:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-030d6f8a-d3ff-4f7b-81bb-d6ec0cb0b02e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.204s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:58 user nova-compute[72992]: INFO nova.compute.manager [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Terminating instance
Aug 15 21:22:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-bb3624a0-a3b9-4f7e-a405-b5aafec1e74f req-8f9493b7-7345-428d-9464-2fc3ae3da016 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bb3624a0-a3b9-4f7e-a405-b5aafec1e74f req-8f9493b7-7345-428d-9464-2fc3ae3da016 service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bb3624a0-a3b9-4f7e-a405-b5aafec1e74f req-8f9493b7-7345-428d-9464-2fc3ae3da016 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bb3624a0-a3b9-4f7e-a405-b5aafec1e74f req-8f9493b7-7345-428d-9464-2fc3ae3da016 service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-bb3624a0-a3b9-4f7e-a405-b5aafec1e74f req-8f9493b7-7345-428d-9464-2fc3ae3da016 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-bb3624a0-a3b9-4f7e-a405-b5aafec1e74f req-8f9493b7-7345-428d-9464-2fc3ae3da016 service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-unplugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:22:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Instance destroyed successfully.
Aug 15 21:22:59 user nova-compute[72992]: DEBUG nova.objects.instance [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'resources' on Instance uuid b198f99d-1575-4ac1-9f66-47d12fda99d9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-552553520',display_name='tempest-AttachVolumeTestJSON-server-552553520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-552553520',id=4,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOMeqDoQcjufNsFqtmfDxVZ5eC3nHjGKM1S3zQezxHS2B+8Nl/c4N7yEHkWn5OPJVOCMv3RSgaCPTP1MLtl9kvZLMvkBr20FXxOa32lTlYn7JrHL6RlnRXOLeqfXGpTnA==',key_name='tempest-keypair-880083791',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-gex4ht48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=b198f99d-1575-4ac1-9f66-47d12fda99d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25b5157e-6099-448c-af89-cc4477901f69", "address": "fa:16:3e:d7:04:4c", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b5157e-60", "ovs_interfaceid": "25b5157e-6099-448c-af89-cc4477901f69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG os_vif [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b5157e-60, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:22:59 user nova-compute[72992]: INFO os_vif [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:04:4c,bridge_name='br-int',has_traffic_filtering=True,id=25b5157e-6099-448c-af89-cc4477901f69,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b5157e-60')
Aug 15 21:22:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Deleting instance files /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9_del
Aug 15 21:22:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Deletion of /opt/stack/data/nova/instances/b198f99d-1575-4ac1-9f66-47d12fda99d9_del complete
Aug 15 21:22:59 user nova-compute[72992]: INFO nova.compute.manager [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 21:22:59 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:22:59 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:23:00 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:00 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Took 1.22 seconds to deallocate network for instance.
Aug 15 21:23:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-c48348b1-9c0f-4729-b45c-d02c45b00eb9 req-929c99bc-645d-4ae0-aec6-f364485d41ed service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c48348b1-9c0f-4729-b45c-d02c45b00eb9 req-929c99bc-645d-4ae0-aec6-f364485d41ed service nova] Acquiring lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c48348b1-9c0f-4729-b45c-d02c45b00eb9 req-929c99bc-645d-4ae0-aec6-f364485d41ed service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c48348b1-9c0f-4729-b45c-d02c45b00eb9 req-929c99bc-645d-4ae0-aec6-f364485d41ed service nova] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-c48348b1-9c0f-4729-b45c-d02c45b00eb9 req-929c99bc-645d-4ae0-aec6-f364485d41ed service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] No waiting events found dispatching network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:00 user nova-compute[72992]: WARNING nova.compute.manager [req-c48348b1-9c0f-4729-b45c-d02c45b00eb9 req-929c99bc-645d-4ae0-aec6-f364485d41ed service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received unexpected event network-vif-plugged-25b5157e-6099-448c-af89-cc4477901f69 for instance with vm_state deleted and task_state None.
Aug 15 21:23:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-c48348b1-9c0f-4729-b45c-d02c45b00eb9 req-929c99bc-645d-4ae0-aec6-f364485d41ed service nova] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Received event network-vif-deleted-25b5157e-6099-448c-af89-cc4477901f69 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:01 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:23:01 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:23:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:01 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Deleted allocations for instance b198f99d-1575-4ac1-9f66-47d12fda99d9
Aug 15 21:23:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46d8ddcf-4cc0-45cf-884e-a6f67542a9da tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "b198f99d-1575-4ac1-9f66-47d12fda99d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.838s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:05 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:07 user nova-compute[72992]: INFO nova.compute.manager [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Terminating instance
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-7a5042c2-7960-4743-9285-5d77d786eef7 req-c59c2bd3-c8c0-4fd7-b80b-aa2d5e5abe27 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-vif-unplugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7a5042c2-7960-4743-9285-5d77d786eef7 req-c59c2bd3-c8c0-4fd7-b80b-aa2d5e5abe27 service nova] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7a5042c2-7960-4743-9285-5d77d786eef7 req-c59c2bd3-c8c0-4fd7-b80b-aa2d5e5abe27 service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7a5042c2-7960-4743-9285-5d77d786eef7 req-c59c2bd3-c8c0-4fd7-b80b-aa2d5e5abe27 service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-7a5042c2-7960-4743-9285-5d77d786eef7 req-c59c2bd3-c8c0-4fd7-b80b-aa2d5e5abe27 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] No waiting events found dispatching network-vif-unplugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-7a5042c2-7960-4743-9285-5d77d786eef7 req-c59c2bd3-c8c0-4fd7-b80b-aa2d5e5abe27 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-vif-unplugged-81d960fd-8d18-453b-b0d8-19031c669131 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:23:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Instance destroyed successfully.
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'resources' on Instance uuid a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-98728588',display_name='tempest-AttachVolumeNegativeTest-server-98728588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-98728588',id=20,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPivA31ecRElxPDqDzfUBkd0ya3fFHPjrFMqfs28ba5zKegyvtuNjjrThC10OLZt42qUx96D/0tZGaEwl6QpVlraM7Tk7MRhXLyi5E/dSQI750KYXmi5mQg4VFm5vjUSHg==',key_name='tempest-keypair-1717924677',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-s2yck6rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=a76eaf1d-abb7-4b60-86e4-1e6883cc5f56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "81d960fd-8d18-453b-b0d8-19031c669131", "address": "fa:16:3e:c3:f2:55", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d960fd-8d", "ovs_interfaceid": "81d960fd-8d18-453b-b0d8-19031c669131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=81d960fd-8d18-453b-b0d8-19031c669131,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d960fd-8d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG os_vif [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=81d960fd-8d18-453b-b0d8-19031c669131,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d960fd-8d') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81d960fd-8d, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:23:08 user nova-compute[72992]: INFO os_vif [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f2:55,bridge_name='br-int',has_traffic_filtering=True,id=81d960fd-8d18-453b-b0d8-19031c669131,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d960fd-8d')
Aug 15 21:23:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Deleting instance files /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56_del
Aug 15 21:23:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Deletion of /opt/stack/data/nova/instances/a76eaf1d-abb7-4b60-86e4-1e6883cc5f56_del complete
Aug 15 21:23:08 user nova-compute[72992]: INFO nova.compute.manager [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:23:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:09 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Took 1.00 seconds to deallocate network for instance.
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-0f4c5a34-3414-41a9-a046-9c7113fa42bd req-cb549764-9806-48c5-9018-3439aee209c0 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0f4c5a34-3414-41a9-a046-9c7113fa42bd req-cb549764-9806-48c5-9018-3439aee209c0 service nova] Acquiring lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0f4c5a34-3414-41a9-a046-9c7113fa42bd req-cb549764-9806-48c5-9018-3439aee209c0 service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0f4c5a34-3414-41a9-a046-9c7113fa42bd req-cb549764-9806-48c5-9018-3439aee209c0 service nova] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-0f4c5a34-3414-41a9-a046-9c7113fa42bd req-cb549764-9806-48c5-9018-3439aee209c0 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] No waiting events found dispatching network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:09 user nova-compute[72992]: WARNING nova.compute.manager [req-0f4c5a34-3414-41a9-a046-9c7113fa42bd req-cb549764-9806-48c5-9018-3439aee209c0 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received unexpected event network-vif-plugged-81d960fd-8d18-453b-b0d8-19031c669131 for instance with vm_state deleted and task_state None.
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-0f4c5a34-3414-41a9-a046-9c7113fa42bd req-cb549764-9806-48c5-9018-3439aee209c0 service nova] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Received event network-vif-deleted-81d960fd-8d18-453b-b0d8-19031c669131 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:09 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Deleted allocations for instance a76eaf1d-abb7-4b60-86e4-1e6883cc5f56
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-changed-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Refreshing instance network info cache due to event network-changed-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] Acquiring lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] Acquired lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Refreshing network info cache for port d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4c5a717-c095-4904-9cd5-1ff9db43e945 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "a76eaf1d-abb7-4b60-86e4-1e6883cc5f56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.642s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG nova.network.neutron [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updated VIF entry in instance network info cache for port d16baeb8-bc61-4b6c-ab85-fbb2ff1af049. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG nova.network.neutron [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d9eb8d94-90f6-4af7-b1f5-56de6fd198c0 req-477d6543-79b7-434b-b679-9e21f8a44c19 service nova] Releasing lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:11 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Error from libvirt while getting description of instance-00000014: [Error Code 42] Domain not found: no domain with matching uuid 'a76eaf1d-abb7-4b60-86e4-1e6883cc5f56' (instance-00000014): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a76eaf1d-abb7-4b60-86e4-1e6883cc5f56' (instance-00000014)
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:13 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:13 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=6816MB free_disk=25.30536651611328GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 9ee81390-8064-4a06-893e-d5238e4b06bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bf2b214b-f493-476b-bf23-7c13ffb3de87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e4c3c4b4-960e-4273-b237-97c9c2c86fde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:23:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:23:14 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:23:14 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:23:14 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:23:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:14 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134579.3622317, b198f99d-1575-4ac1-9f66-47d12fda99d9 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:23:14 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] VM Stopped (Lifecycle Event)
Aug 15 21:23:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-88172dfe-fc5d-400c-aa51-90339d0fb1f4 None None] [instance: b198f99d-1575-4ac1-9f66-47d12fda99d9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updating instance_info_cache with network_info: [{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:23:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:23:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:22 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134587.9686275, a76eaf1d-abb7-4b60-86e4-1e6883cc5f56 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:23:22 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] VM Stopped (Lifecycle Event)
Aug 15 21:23:22 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0942170-1bd8-43b1-a480-5c4e50551c7e None None] [instance: a76eaf1d-abb7-4b60-86e4-1e6883cc5f56] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:23:26 user nova-compute[72992]: INFO nova.compute.claims [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Claim successful on node user
Aug 15 21:23:26 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:23:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.policy [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '426fd37dacd64b46b9f8e5d93f052265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9937b37364574383bb2bee6622aa04c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:23:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Creating image(s)
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk 1073741824" returned: 0 in 0.050s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Successfully created port: e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:23:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Cannot resize image /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.objects.instance [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'migration_context' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Ensure instance console log exists: /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Successfully updated port: e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquired lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-changed-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Refreshing instance network info cache due to event network-changed-e4038664-f682-4738-afe1-42891cbda0c6. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] Acquiring lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating instance_info_cache with network_info: [{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Releasing lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance network_info: |[{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] Acquired lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Refreshing network info cache for port e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Start _get_guest_xml network_info=[{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:23:28 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:28 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:23:28 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819635464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819635464',id=27,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbZznfDDGD0iZIucT6QHthsMyTBp+iA4rK6C3Vo5rzePxuQwULUvNhbFZLK1Q2Dy7XO1TMTfA4CVUIoMgfaQNS+A4I4GY1atSalYH+J29ji0QmsjasrLCyTLhFBp7RBQ==',key_name='tempest-keypair-903603687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-4tuo9m5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=4b290dce-4696-42ab-9b7b-fa36a6812481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:23:29 user nova-compute[72992]:   <uuid>4b290dce-4696-42ab-9b7b-fa36a6812481</uuid>
Aug 15 21:23:29 user nova-compute[72992]:   <name>instance-0000001b</name>
Aug 15 21:23:29 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:23:29 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:23:29 user nova-compute[72992]:   <metadata>
Aug 15 21:23:29 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:23:29 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:23:29 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1819635464</nova:name>
Aug 15 21:23:29 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:23:28</nova:creationTime>
Aug 15 21:23:29 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:23:29 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:23:29 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:23:29 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:23:29 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:23:29 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:23:29 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:23:29 user nova-compute[72992]:       <nova:owner>
Aug 15 21:23:29 user nova-compute[72992]:         <nova:user uuid="426fd37dacd64b46b9f8e5d93f052265">tempest-AttachVolumeShelveTestJSON-1272311701-project-member</nova:user>
Aug 15 21:23:29 user nova-compute[72992]:         <nova:project uuid="9937b37364574383bb2bee6622aa04c2">tempest-AttachVolumeShelveTestJSON-1272311701</nova:project>
Aug 15 21:23:29 user nova-compute[72992]:       </nova:owner>
Aug 15 21:23:29 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:23:29 user nova-compute[72992]:       <nova:ports>
Aug 15 21:23:29 user nova-compute[72992]:         <nova:port uuid="e4038664-f682-4738-afe1-42891cbda0c6">
Aug 15 21:23:29 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:23:29 user nova-compute[72992]:         </nova:port>
Aug 15 21:23:29 user nova-compute[72992]:       </nova:ports>
Aug 15 21:23:29 user nova-compute[72992]:     </nova:instance>
Aug 15 21:23:29 user nova-compute[72992]:   </metadata>
Aug 15 21:23:29 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:23:29 user nova-compute[72992]:     <system>
Aug 15 21:23:29 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:23:29 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:23:29 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:23:29 user nova-compute[72992]:       <entry name="serial">4b290dce-4696-42ab-9b7b-fa36a6812481</entry>
Aug 15 21:23:29 user nova-compute[72992]:       <entry name="uuid">4b290dce-4696-42ab-9b7b-fa36a6812481</entry>
Aug 15 21:23:29 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:23:29 user nova-compute[72992]:     </system>
Aug 15 21:23:29 user nova-compute[72992]:   </sysinfo>
Aug 15 21:23:29 user nova-compute[72992]:   <os>
Aug 15 21:23:29 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:23:29 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:23:29 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:23:29 user nova-compute[72992]:   </os>
Aug 15 21:23:29 user nova-compute[72992]:   <features>
Aug 15 21:23:29 user nova-compute[72992]:     <acpi/>
Aug 15 21:23:29 user nova-compute[72992]:     <apic/>
Aug 15 21:23:29 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:23:29 user nova-compute[72992]:   </features>
Aug 15 21:23:29 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:23:29 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:23:29 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:23:29 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:23:29 user nova-compute[72992]:   </clock>
Aug 15 21:23:29 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:23:29 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:23:29 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:23:29 user nova-compute[72992]:   </cpu>
Aug 15 21:23:29 user nova-compute[72992]:   <devices>
Aug 15 21:23:29 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:23:29 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:23:29 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk"/>
Aug 15 21:23:29 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:23:29 user nova-compute[72992]:     </disk>
Aug 15 21:23:29 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:23:29 user nova-compute[72992]:       <mac address="fa:16:3e:1f:c9:72"/>
Aug 15 21:23:29 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:23:29 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:23:29 user nova-compute[72992]:       <target dev="tape4038664-f6"/>
Aug 15 21:23:29 user nova-compute[72992]:     </interface>
Aug 15 21:23:29 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:23:29 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/console.log" append="off"/>
Aug 15 21:23:29 user nova-compute[72992]:     </serial>
Aug 15 21:23:29 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:23:29 user nova-compute[72992]:     <video>
Aug 15 21:23:29 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:23:29 user nova-compute[72992]:     </video>
Aug 15 21:23:29 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:23:29 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:23:29 user nova-compute[72992]:     </rng>
Aug 15 21:23:29 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:23:29 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:23:29 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:23:29 user nova-compute[72992]:     </memballoon>
Aug 15 21:23:29 user nova-compute[72992]:   </devices>
Aug 15 21:23:29 user nova-compute[72992]: </domain>
Aug 15 21:23:29 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819635464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819635464',id=27,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbZznfDDGD0iZIucT6QHthsMyTBp+iA4rK6C3Vo5rzePxuQwULUvNhbFZLK1Q2Dy7XO1TMTfA4CVUIoMgfaQNS+A4I4GY1atSalYH+J29ji0QmsjasrLCyTLhFBp7RBQ==',key_name='tempest-keypair-903603687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-4tuo9m5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:23:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=4b290dce-4696-42ab-9b7b-fa36a6812481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG os_vif [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4038664-f6, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4038664-f6, col_values=(('external_ids', {'iface-id': 'e4038664-f682-4738-afe1-42891cbda0c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:c9:72', 'vm-uuid': '4b290dce-4696-42ab-9b7b-fa36a6812481'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:29 user nova-compute[72992]: INFO os_vif [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6')
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No VIF found with MAC fa:16:3e:1f:c9:72, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updated VIF entry in instance network info cache for port e4038664-f682-4738-afe1-42891cbda0c6. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating instance_info_cache with network_info: [{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6024fd9e-19a1-40ca-a240-7157c2b2cf65 req-8fe57d99-0c2e-4182-b32d-d69750d66dc8 service nova] Releasing lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-e7fb8aa6-2deb-4ed4-abb2-974e4568c477 req-aee64ada-88d7-442f-b3e6-9b26aa74fd41 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e7fb8aa6-2deb-4ed4-abb2-974e4568c477 req-aee64ada-88d7-442f-b3e6-9b26aa74fd41 service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e7fb8aa6-2deb-4ed4-abb2-974e4568c477 req-aee64ada-88d7-442f-b3e6-9b26aa74fd41 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e7fb8aa6-2deb-4ed4-abb2-974e4568c477 req-aee64ada-88d7-442f-b3e6-9b26aa74fd41 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-e7fb8aa6-2deb-4ed4-abb2-974e4568c477 req-aee64ada-88d7-442f-b3e6-9b26aa74fd41 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:30 user nova-compute[72992]: WARNING nova.compute.manager [req-e7fb8aa6-2deb-4ed4-abb2-974e4568c477 req-aee64ada-88d7-442f-b3e6-9b26aa74fd41 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received unexpected event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with vm_state building and task_state spawning.
Aug 15 21:23:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing instance network info cache due to event network-changed-438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] Acquiring lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] Acquired lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Refreshing network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:30 user nova-compute[72992]: INFO nova.compute.manager [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Terminating instance
Aug 15 21:23:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-3e8378f2-31b3-4ac3-9b88-b5e177fabdf1 req-f8a72348-6675-4c38-8c0e-01a396fd52e5 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-unplugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e8378f2-31b3-4ac3-9b88-b5e177fabdf1 req-f8a72348-6675-4c38-8c0e-01a396fd52e5 service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e8378f2-31b3-4ac3-9b88-b5e177fabdf1 req-f8a72348-6675-4c38-8c0e-01a396fd52e5 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e8378f2-31b3-4ac3-9b88-b5e177fabdf1 req-f8a72348-6675-4c38-8c0e-01a396fd52e5 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-3e8378f2-31b3-4ac3-9b88-b5e177fabdf1 req-f8a72348-6675-4c38-8c0e-01a396fd52e5 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-unplugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-3e8378f2-31b3-4ac3-9b88-b5e177fabdf1 req-f8a72348-6675-4c38-8c0e-01a396fd52e5 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-unplugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updated VIF entry in instance network info cache for port 438b1af6-fce1-4c3e-a0c6-f20be618e1c3. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [{"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6a9a999f-b20a-4328-8a0f-19ae22af09e8 req-74b23884-6d9c-4d67-afb9-5c1ebc69f77f service nova] Releasing lock "refresh_cache-9ee81390-8064-4a06-893e-d5238e4b06bc" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:31 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Instance destroyed successfully.
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lazy-loading 'resources' on Instance uuid 9ee81390-8064-4a06-893e-d5238e4b06bc {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-273239992',display_name='tempest-TestShelveInstance-server-273239992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-273239992',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLairPAAwvAX2jiTJ099QyJUqxtL2jIpk9nCo2wSzOMbPg5kCoaKE2Ih7euYv4rQIUeKBc2YSt299/p/DDBMFtMYqkgkMYnk8rDscE3tTkzwkKhsjwR83q0qfFNRi1XYQ==',key_name='tempest-TestShelveInstance-172315357',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52c2b71054a944de87abfb5fad8101d1',ramdisk_id='',reservation_id='r-7jqfcmob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-526170969',owner_user_name='tempest-TestShelveInstance-526170969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:22:04Z,user_data=None,user_id='44b6f1facf97472fb22015645ce76a82',uuid=9ee81390-8064-4a06-893e-d5238e4b06bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converting VIF {"id": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "address": "fa:16:3e:ba:c7:bf", "network": {"id": "fb620920-9a78-4e07-9f3d-0bdd101ab8db", "bridge": "br-int", "label": "tempest-TestShelveInstance-1134837437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52c2b71054a944de87abfb5fad8101d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438b1af6-fc", "ovs_interfaceid": "438b1af6-fce1-4c3e-a0c6-f20be618e1c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_vif [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap438b1af6-fc, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:31 user nova-compute[72992]: INFO os_vif [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c7:bf,bridge_name='br-int',has_traffic_filtering=True,id=438b1af6-fce1-4c3e-a0c6-f20be618e1c3,network=Network(fb620920-9a78-4e07-9f3d-0bdd101ab8db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438b1af6-fc')
Aug 15 21:23:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcegjNQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:23:31 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abd864e-e34b-4bee-a8f7-bc78e926c210]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08cb22-81df-4cda-85b2-609ab7adf369]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:23:31 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:23:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:23:31 user nova-compute[72992]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e (non-flash)
Aug 15 21:23:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c59a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f12e305-edba-40e9-8135-881c468e3b90]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f065d-39e2-433e-b165-99ccd16c974e]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b521942-705b-45d8-bec7-a33f74b07768]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:23:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af69165-1abc-475a-8b1b-96f8a7e11145]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3cfa95f', '/dev/disk/by-id/scsi-1SCST_BIO3cfa95f-a5cbe2c85385af7d', '/dev/disk/by-id/scsi-26135636265326338') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269c78a-0518-4e3c-bf10-3c9059e63fb5]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e77da7a-64d8-4102-91af-6f6fc1908d38]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[be00e0b8-84d1-4a87-b08d-31fad9863e39]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260]
Aug 15 21:23:32 user nova-compute[72992]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e, portal: 172.16.0.220,3260] successful.
Aug 15 21:23:32 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d304ae-d80d-4559-a63b-97fb29ea960e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c4e3bb-60e4-4894-abcf-c21ecce23c17]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] <== disconnect_volume: return (324ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Deleting instance files /opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc_del
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Deletion of /opt/stack/data/nova/instances/9ee81390-8064-4a06-893e-d5238e4b06bc_del complete
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.compute.manager [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Took 0.59 seconds to deallocate network for instance.
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134612.861976, 4b290dce-4696-42ab-9b7b-fa36a6812481 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] VM Resumed (Lifecycle Event)
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance spawned successfully.
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-35a3b145-bab5-4ad4-aecd-273f35265b5c req-8955273d-1789-4a60-8280-9f638db39e92 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-35a3b145-bab5-4ad4-aecd-273f35265b5c req-8955273d-1789-4a60-8280-9f638db39e92 service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-35a3b145-bab5-4ad4-aecd-273f35265b5c req-8955273d-1789-4a60-8280-9f638db39e92 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-35a3b145-bab5-4ad4-aecd-273f35265b5c req-8955273d-1789-4a60-8280-9f638db39e92 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-35a3b145-bab5-4ad4-aecd-273f35265b5c req-8955273d-1789-4a60-8280-9f638db39e92 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:32 user nova-compute[72992]: WARNING nova.compute.manager [req-35a3b145-bab5-4ad4-aecd-273f35265b5c req-8955273d-1789-4a60-8280-9f638db39e92 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received unexpected event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with vm_state building and task_state spawning.
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134612.8645704, 4b290dce-4696-42ab-9b7b-fa36a6812481 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] VM Started (Lifecycle Event)
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 15 21:23:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:32 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:23:33 user nova-compute[72992]: INFO nova.compute.manager [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Took 6.66 seconds to build instance.
Aug 15 21:23:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-570dbaf5-3617-41a9-a43c-49fb99b5950e tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.784s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-66079b87-dcab-49cb-b9f0-54c491523e0b req-ab4c02f6-80e2-47a6-bbe8-e6dddc5d5a28 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-66079b87-dcab-49cb-b9f0-54c491523e0b req-ab4c02f6-80e2-47a6-bbe8-e6dddc5d5a28 service nova] Acquiring lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-66079b87-dcab-49cb-b9f0-54c491523e0b req-ab4c02f6-80e2-47a6-bbe8-e6dddc5d5a28 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-66079b87-dcab-49cb-b9f0-54c491523e0b req-ab4c02f6-80e2-47a6-bbe8-e6dddc5d5a28 service nova] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-66079b87-dcab-49cb-b9f0-54c491523e0b req-ab4c02f6-80e2-47a6-bbe8-e6dddc5d5a28 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] No waiting events found dispatching network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:33 user nova-compute[72992]: WARNING nova.compute.manager [req-66079b87-dcab-49cb-b9f0-54c491523e0b req-ab4c02f6-80e2-47a6-bbe8-e6dddc5d5a28 service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received unexpected event network-vif-plugged-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 for instance with vm_state active and task_state deleting.
Aug 15 21:23:33 user nova-compute[72992]: INFO nova.compute.manager [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Took 0.83 seconds to detach 1 volumes for instance.
Aug 15 21:23:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Deleting volume: 78d304ae-d80d-4559-a63b-97fb29ea960e {{(pid=72992) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 21:23:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:34 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:23:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:23:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:34 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Deleted allocations for instance 9ee81390-8064-4a06-893e-d5238e4b06bc
Aug 15 21:23:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1e639a4b-d1ed-4176-a797-7b4b299d5d0f tempest-TestShelveInstance-526170969 tempest-TestShelveInstance-526170969-project-member] Lock "9ee81390-8064-4a06-893e-d5238e4b06bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.566s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-f035a764-0c7b-4f09-89ef-fe496391def0 req-326522f4-da70-4349-a01f-6d105da0d72f service nova] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Received event network-vif-deleted-438b1af6-fce1-4c3e-a0c6-f20be618e1c3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "f596ced0-6e95-44bb-961a-76622ff4fbf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:23:37 user nova-compute[72992]: INFO nova.compute.claims [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Claim successful on node user
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:23:37 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:23:37 user nova-compute[72992]: DEBUG nova.policy [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d9bab564e134919a835eb6c932e3c7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '012f4eadf36d411ab5f9f38ae8910e33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:23:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Creating image(s)
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "/opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "/opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "/opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk 1073741824" returned: 0 in 0.053s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Successfully created port: 6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Cannot resize image /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lazy-loading 'migration_context' on Instance uuid f596ced0-6e95-44bb-961a-76622ff4fbf8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Ensure instance console log exists: /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Successfully updated port: 6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "refresh_cache-f596ced0-6e95-44bb-961a-76622ff4fbf8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquired lock "refresh_cache-f596ced0-6e95-44bb-961a-76622ff4fbf8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received event network-changed-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Refreshing instance network info cache due to event network-changed-6006e89b-7652-4276-97fa-eecea3ce77ec. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] Acquiring lock "refresh_cache-f596ced0-6e95-44bb-961a-76622ff4fbf8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Updating instance_info_cache with network_info: [{"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Releasing lock "refresh_cache-f596ced0-6e95-44bb-961a-76622ff4fbf8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Instance network_info: |[{"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] Acquired lock "refresh_cache-f596ced0-6e95-44bb-961a-76622ff4fbf8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Refreshing network info cache for port 6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Start _get_guest_xml network_info=[{"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:23:39 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:39 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:23:39 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-420436157',display_name='tempest-ServersNegativeTestJSON-server-420436157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-420436157',id=28,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='012f4eadf36d411ab5f9f38ae8910e33',ramdisk_id='',reservation_id='r-xju7bw48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-827890923',owner_user_name='tempest-ServersNegativeTestJSON-827890923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:23:38Z,user_data=None,user_id='7d9bab564e134919a835eb6c932e3c7b',uuid=f596ced0-6e95-44bb-961a-76622ff4fbf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converting VIF {"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:93:40,bridge_name='br-int',has_traffic_filtering=True,id=6006e89b-7652-4276-97fa-eecea3ce77ec,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6006e89b-76') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lazy-loading 'pci_devices' on Instance uuid f596ced0-6e95-44bb-961a-76622ff4fbf8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:23:40 user nova-compute[72992]:   <uuid>f596ced0-6e95-44bb-961a-76622ff4fbf8</uuid>
Aug 15 21:23:40 user nova-compute[72992]:   <name>instance-0000001c</name>
Aug 15 21:23:40 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:23:40 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:23:40 user nova-compute[72992]:   <metadata>
Aug 15 21:23:40 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:23:40 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:23:40 user nova-compute[72992]:       <nova:name>tempest-ServersNegativeTestJSON-server-420436157</nova:name>
Aug 15 21:23:40 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:23:39</nova:creationTime>
Aug 15 21:23:40 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:23:40 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:23:40 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:23:40 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:23:40 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:23:40 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:23:40 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:23:40 user nova-compute[72992]:       <nova:owner>
Aug 15 21:23:40 user nova-compute[72992]:         <nova:user uuid="7d9bab564e134919a835eb6c932e3c7b">tempest-ServersNegativeTestJSON-827890923-project-member</nova:user>
Aug 15 21:23:40 user nova-compute[72992]:         <nova:project uuid="012f4eadf36d411ab5f9f38ae8910e33">tempest-ServersNegativeTestJSON-827890923</nova:project>
Aug 15 21:23:40 user nova-compute[72992]:       </nova:owner>
Aug 15 21:23:40 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:23:40 user nova-compute[72992]:       <nova:ports>
Aug 15 21:23:40 user nova-compute[72992]:         <nova:port uuid="6006e89b-7652-4276-97fa-eecea3ce77ec">
Aug 15 21:23:40 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:23:40 user nova-compute[72992]:         </nova:port>
Aug 15 21:23:40 user nova-compute[72992]:       </nova:ports>
Aug 15 21:23:40 user nova-compute[72992]:     </nova:instance>
Aug 15 21:23:40 user nova-compute[72992]:   </metadata>
Aug 15 21:23:40 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:23:40 user nova-compute[72992]:     <system>
Aug 15 21:23:40 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:23:40 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:23:40 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:23:40 user nova-compute[72992]:       <entry name="serial">f596ced0-6e95-44bb-961a-76622ff4fbf8</entry>
Aug 15 21:23:40 user nova-compute[72992]:       <entry name="uuid">f596ced0-6e95-44bb-961a-76622ff4fbf8</entry>
Aug 15 21:23:40 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:23:40 user nova-compute[72992]:     </system>
Aug 15 21:23:40 user nova-compute[72992]:   </sysinfo>
Aug 15 21:23:40 user nova-compute[72992]:   <os>
Aug 15 21:23:40 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:23:40 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:23:40 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:23:40 user nova-compute[72992]:   </os>
Aug 15 21:23:40 user nova-compute[72992]:   <features>
Aug 15 21:23:40 user nova-compute[72992]:     <acpi/>
Aug 15 21:23:40 user nova-compute[72992]:     <apic/>
Aug 15 21:23:40 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:23:40 user nova-compute[72992]:   </features>
Aug 15 21:23:40 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:23:40 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:23:40 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:23:40 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:23:40 user nova-compute[72992]:   </clock>
Aug 15 21:23:40 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:23:40 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:23:40 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:23:40 user nova-compute[72992]:   </cpu>
Aug 15 21:23:40 user nova-compute[72992]:   <devices>
Aug 15 21:23:40 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:23:40 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:23:40 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk"/>
Aug 15 21:23:40 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:23:40 user nova-compute[72992]:     </disk>
Aug 15 21:23:40 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:23:40 user nova-compute[72992]:       <mac address="fa:16:3e:8d:93:40"/>
Aug 15 21:23:40 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:23:40 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:23:40 user nova-compute[72992]:       <target dev="tap6006e89b-76"/>
Aug 15 21:23:40 user nova-compute[72992]:     </interface>
Aug 15 21:23:40 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:23:40 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/console.log" append="off"/>
Aug 15 21:23:40 user nova-compute[72992]:     </serial>
Aug 15 21:23:40 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:23:40 user nova-compute[72992]:     <video>
Aug 15 21:23:40 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:23:40 user nova-compute[72992]:     </video>
Aug 15 21:23:40 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:23:40 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:23:40 user nova-compute[72992]:     </rng>
Aug 15 21:23:40 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:23:40 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:23:40 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:23:40 user nova-compute[72992]:     </memballoon>
Aug 15 21:23:40 user nova-compute[72992]:   </devices>
Aug 15 21:23:40 user nova-compute[72992]: </domain>
Aug 15 21:23:40 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-420436157',display_name='tempest-ServersNegativeTestJSON-server-420436157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-420436157',id=28,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='012f4eadf36d411ab5f9f38ae8910e33',ramdisk_id='',reservation_id='r-xju7bw48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-827890923',owner_user_name='tempest-ServersNegativeTestJSON-827890923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:23:38Z,user_data=None,user_id='7d9bab564e134919a835eb6c932e3c7b',uuid=f596ced0-6e95-44bb-961a-76622ff4fbf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converting VIF {"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:93:40,bridge_name='br-int',has_traffic_filtering=True,id=6006e89b-7652-4276-97fa-eecea3ce77ec,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6006e89b-76') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG os_vif [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:93:40,bridge_name='br-int',has_traffic_filtering=True,id=6006e89b-7652-4276-97fa-eecea3ce77ec,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6006e89b-76') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6006e89b-76, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6006e89b-76, col_values=(('external_ids', {'iface-id': '6006e89b-7652-4276-97fa-eecea3ce77ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:93:40', 'vm-uuid': 'f596ced0-6e95-44bb-961a-76622ff4fbf8'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:40 user nova-compute[72992]: INFO os_vif [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:93:40,bridge_name='br-int',has_traffic_filtering=True,id=6006e89b-7652-4276-97fa-eecea3ce77ec,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6006e89b-76')
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] No VIF found with MAC fa:16:3e:8d:93:40, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.network.neutron [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Updated VIF entry in instance network info cache for port 6006e89b-7652-4276-97fa-eecea3ce77ec. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.network.neutron [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Updating instance_info_cache with network_info: [{"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-10dbec01-bff4-4d87-a178-6caff9781469 req-7cead9fb-47ef-4ce3-b475-58aadc73b77b service nova] Releasing lock "refresh_cache-f596ced0-6e95-44bb-961a-76622ff4fbf8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:41 user nova-compute[72992]: INFO nova.compute.manager [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] instance snapshotting
Aug 15 21:23:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Beginning live snapshot process
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json -f qcow2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-8d60ce7c-4a05-4417-895e-ca8f5f6b6f1c req-46be7e8e-1f46-424e-ba14-a201ccd63d55 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received event network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8d60ce7c-4a05-4417-895e-ca8f5f6b6f1c req-46be7e8e-1f46-424e-ba14-a201ccd63d55 service nova] Acquiring lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8d60ce7c-4a05-4417-895e-ca8f5f6b6f1c req-46be7e8e-1f46-424e-ba14-a201ccd63d55 service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8d60ce7c-4a05-4417-895e-ca8f5f6b6f1c req-46be7e8e-1f46-424e-ba14-a201ccd63d55 service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-8d60ce7c-4a05-4417-895e-ca8f5f6b6f1c req-46be7e8e-1f46-424e-ba14-a201ccd63d55 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] No waiting events found dispatching network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:41 user nova-compute[72992]: WARNING nova.compute.manager [req-8d60ce7c-4a05-4417-895e-ca8f5f6b6f1c req-46be7e8e-1f46-424e-ba14-a201ccd63d55 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received unexpected event network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec for instance with vm_state building and task_state spawning.
Aug 15 21:23:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9x0c_cax/a0e220545c564fa192e023db6802a155.delta 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9x0c_cax/a0e220545c564fa192e023db6802a155.delta 1073741824" returned: 0 in 0.053s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 21:23:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] COPY block job progress, current cursor: 20381696 final cursor: 75497472 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72992) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 21:23:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 21:23:43 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9x0c_cax/a0e220545c564fa192e023db6802a155.delta /opt/stack/data/nova/instances/snapshots/tmp9x0c_cax/a0e220545c564fa192e023db6802a155 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-2e88c311-aa7d-46bc-8c1b-0b5fd71bf16c req-67cbb622-fa45-453b-a494-6346e627c7ef service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received event network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2e88c311-aa7d-46bc-8c1b-0b5fd71bf16c req-67cbb622-fa45-453b-a494-6346e627c7ef service nova] Acquiring lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2e88c311-aa7d-46bc-8c1b-0b5fd71bf16c req-67cbb622-fa45-453b-a494-6346e627c7ef service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2e88c311-aa7d-46bc-8c1b-0b5fd71bf16c req-67cbb622-fa45-453b-a494-6346e627c7ef service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-2e88c311-aa7d-46bc-8c1b-0b5fd71bf16c req-67cbb622-fa45-453b-a494-6346e627c7ef service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] No waiting events found dispatching network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:43 user nova-compute[72992]: WARNING nova.compute.manager [req-2e88c311-aa7d-46bc-8c1b-0b5fd71bf16c req-67cbb622-fa45-453b-a494-6346e627c7ef service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received unexpected event network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec for instance with vm_state building and task_state spawning.
Aug 15 21:23:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9x0c_cax/a0e220545c564fa192e023db6802a155.delta /opt/stack/data/nova/instances/snapshots/tmp9x0c_cax/a0e220545c564fa192e023db6802a155" returned: 0 in 0.360s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Snapshot extracted, beginning image upload
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134624.5669653, f596ced0-6e95-44bb-961a-76622ff4fbf8 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] VM Resumed (Lifecycle Event)
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Instance spawned successfully.
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134624.5688784, f596ced0-6e95-44bb-961a-76622ff4fbf8 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] VM Started (Lifecycle Event)
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 15 21:23:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:44 user nova-compute[72992]: INFO nova.compute.manager [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Took 7.71 seconds to build instance.
Aug 15 21:23:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5f4348b8-8322-4969-9b5e-48f40d1834aa tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.811s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:46 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134611.7438986, 9ee81390-8064-4a06-893e-d5238e4b06bc => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:23:46 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] VM Stopped (Lifecycle Event)
Aug 15 21:23:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5ee29d2e-e303-4c25-a316-d008715ae302 None None] [instance: 9ee81390-8064-4a06-893e-d5238e4b06bc] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:23:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Snapshot image upload complete
Aug 15 21:23:46 user nova-compute[72992]: INFO nova.compute.manager [None req-f7e459c2-1ba2-47d9-9a85-1b65a84b4a29 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Took 5.81 seconds to snapshot the instance on the hypervisor.
Aug 15 21:23:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing instance network info cache due to event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] Acquiring lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] Acquired lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'flavor' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:48 user nova-compute[72992]: INFO nova.compute.manager [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Attaching volume 48d2da2a-74cc-4e7a-82a3-1317772a0c22 to /dev/vdb
Aug 15 21:23:48 user nova-compute[72992]: DEBUG os_brick.utils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[085eda1c-0f4f-4290-b864-2f76cee3b11e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f1756a-4b58-45ab-a994-d3d430e6ace2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[49511b88-b12e-4a1f-b8db-41a7bacd7ccf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[666652a6-2856-4526-a61e-63ab4e5c6513]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updated VIF entry in instance network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:23:48 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52c0450-ab01-4555-b7cf-29d28ab705a2]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG os_brick.utils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating existing volume attachment record: 4fb9a417-079f-4b93-8823-dd8b8ccf75bb {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:23:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6cc2a1a8-a1d5-495d-9795-cd4e41ca67ae req-32bba1e4-738a-4c3a-a37d-b6ac2d4d9164 service nova] Releasing lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:23:53 user nova-compute[72992]: INFO nova.compute.claims [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Claim successful on node user
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:23:53 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:23:53 user nova-compute[72992]: DEBUG nova.policy [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6ff1260094b492086d5ae874ed7dd0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b55df905a9e64949ac35075fb206991e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:23:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Creating image(s)
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "/opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "/opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "/opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk 1073741824" returned: 0 in 0.054s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Successfully created port: 25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Cannot resize image /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'migration_context' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Ensure instance console log exists: /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Successfully updated port: 25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquired lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-changed-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Refreshing instance network info cache due to event network-changed-25d7d1e7-b900-43a8-b497-cddd93d7b252. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] Acquiring lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:23:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updating instance_info_cache with network_info: [{"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Releasing lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Instance network_info: |[{"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] Acquired lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Refreshing network info cache for port 25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Start _get_guest_xml network_info=[{"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:23:56 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:56 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-567564830',display_name='tempest-AttachVolumeTestJSON-server-567564830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-567564830',id=29,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSLRpXuqjYYtP1uVhFAVnNzW6FduooU7SgFkza/5He3GphVVf1ayukoyreYGOZ7HWVVHjgdnQO+JVHA30+nK8e5RxY41ATelbjeCecYqGYuXYu1fuf/ZRwQvxFFxgsGRA==',key_name='tempest-keypair-1544559500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-scqaiybo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=5318a1d1-16c0-4b24-b48d-b557c6f061c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:09:cd,bridge_name='br-int',has_traffic_filtering=True,id=25d7d1e7-b900-43a8-b497-cddd93d7b252,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d7d1e7-b9') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'pci_devices' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:23:56 user nova-compute[72992]:   <uuid>5318a1d1-16c0-4b24-b48d-b557c6f061c8</uuid>
Aug 15 21:23:56 user nova-compute[72992]:   <name>instance-0000001d</name>
Aug 15 21:23:56 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:23:56 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:23:56 user nova-compute[72992]:   <metadata>
Aug 15 21:23:56 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:23:56 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:23:56 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeTestJSON-server-567564830</nova:name>
Aug 15 21:23:56 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:23:56</nova:creationTime>
Aug 15 21:23:56 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:23:56 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:23:56 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:23:56 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:23:56 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:23:56 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:23:56 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:23:56 user nova-compute[72992]:       <nova:owner>
Aug 15 21:23:56 user nova-compute[72992]:         <nova:user uuid="c6ff1260094b492086d5ae874ed7dd0d">tempest-AttachVolumeTestJSON-2136218087-project-member</nova:user>
Aug 15 21:23:56 user nova-compute[72992]:         <nova:project uuid="b55df905a9e64949ac35075fb206991e">tempest-AttachVolumeTestJSON-2136218087</nova:project>
Aug 15 21:23:56 user nova-compute[72992]:       </nova:owner>
Aug 15 21:23:56 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:23:56 user nova-compute[72992]:       <nova:ports>
Aug 15 21:23:56 user nova-compute[72992]:         <nova:port uuid="25d7d1e7-b900-43a8-b497-cddd93d7b252">
Aug 15 21:23:56 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 21:23:56 user nova-compute[72992]:         </nova:port>
Aug 15 21:23:56 user nova-compute[72992]:       </nova:ports>
Aug 15 21:23:56 user nova-compute[72992]:     </nova:instance>
Aug 15 21:23:56 user nova-compute[72992]:   </metadata>
Aug 15 21:23:56 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:23:56 user nova-compute[72992]:     <system>
Aug 15 21:23:56 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:23:56 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:23:56 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:23:56 user nova-compute[72992]:       <entry name="serial">5318a1d1-16c0-4b24-b48d-b557c6f061c8</entry>
Aug 15 21:23:56 user nova-compute[72992]:       <entry name="uuid">5318a1d1-16c0-4b24-b48d-b557c6f061c8</entry>
Aug 15 21:23:56 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:23:56 user nova-compute[72992]:     </system>
Aug 15 21:23:56 user nova-compute[72992]:   </sysinfo>
Aug 15 21:23:56 user nova-compute[72992]:   <os>
Aug 15 21:23:56 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:23:56 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:23:56 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:23:56 user nova-compute[72992]:   </os>
Aug 15 21:23:56 user nova-compute[72992]:   <features>
Aug 15 21:23:56 user nova-compute[72992]:     <acpi/>
Aug 15 21:23:56 user nova-compute[72992]:     <apic/>
Aug 15 21:23:56 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:23:56 user nova-compute[72992]:   </features>
Aug 15 21:23:56 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:23:56 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:23:56 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:23:56 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:23:56 user nova-compute[72992]:   </clock>
Aug 15 21:23:56 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:23:56 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:23:56 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:23:56 user nova-compute[72992]:   </cpu>
Aug 15 21:23:56 user nova-compute[72992]:   <devices>
Aug 15 21:23:56 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:23:56 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:23:56 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk"/>
Aug 15 21:23:56 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:23:56 user nova-compute[72992]:     </disk>
Aug 15 21:23:56 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:23:56 user nova-compute[72992]:       <mac address="fa:16:3e:c2:09:cd"/>
Aug 15 21:23:56 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:23:56 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:23:56 user nova-compute[72992]:       <target dev="tap25d7d1e7-b9"/>
Aug 15 21:23:56 user nova-compute[72992]:     </interface>
Aug 15 21:23:56 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:23:56 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/console.log" append="off"/>
Aug 15 21:23:56 user nova-compute[72992]:     </serial>
Aug 15 21:23:56 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:23:56 user nova-compute[72992]:     <video>
Aug 15 21:23:56 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:23:56 user nova-compute[72992]:     </video>
Aug 15 21:23:56 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:23:56 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:23:56 user nova-compute[72992]:     </rng>
Aug 15 21:23:56 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:23:56 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:23:56 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:23:56 user nova-compute[72992]:     </memballoon>
Aug 15 21:23:56 user nova-compute[72992]:   </devices>
Aug 15 21:23:56 user nova-compute[72992]: </domain>
Aug 15 21:23:56 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-567564830',display_name='tempest-AttachVolumeTestJSON-server-567564830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-567564830',id=29,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSLRpXuqjYYtP1uVhFAVnNzW6FduooU7SgFkza/5He3GphVVf1ayukoyreYGOZ7HWVVHjgdnQO+JVHA30+nK8e5RxY41ATelbjeCecYqGYuXYu1fuf/ZRwQvxFFxgsGRA==',key_name='tempest-keypair-1544559500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-scqaiybo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=5318a1d1-16c0-4b24-b48d-b557c6f061c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:09:cd,bridge_name='br-int',has_traffic_filtering=True,id=25d7d1e7-b900-43a8-b497-cddd93d7b252,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d7d1e7-b9') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG os_vif [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:09:cd,bridge_name='br-int',has_traffic_filtering=True,id=25d7d1e7-b900-43a8-b497-cddd93d7b252,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d7d1e7-b9') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25d7d1e7-b9, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25d7d1e7-b9, col_values=(('external_ids', {'iface-id': '25d7d1e7-b900-43a8-b497-cddd93d7b252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:09:cd', 'vm-uuid': '5318a1d1-16c0-4b24-b48d-b557c6f061c8'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:56 user nova-compute[72992]: INFO os_vif [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:09:cd,bridge_name='br-int',has_traffic_filtering=True,id=25d7d1e7-b900-43a8-b497-cddd93d7b252,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d7d1e7-b9')
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No VIF found with MAC fa:16:3e:c2:09:cd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updated VIF entry in instance network info cache for port 25d7d1e7-b900-43a8-b497-cddd93d7b252. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updating instance_info_cache with network_info: [{"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:23:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-96815ccc-e094-42f5-b8f1-3b7852eb65f7 req-470d2aad-fae9-403c-a889-f7c481107a01 service nova] Releasing lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:23:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-56e8b20e-c87d-4dc2-a0a2-3ca8c150fa73 req-7a4bf294-ec47-45b1-91c2-00c966ed1e56 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-56e8b20e-c87d-4dc2-a0a2-3ca8c150fa73 req-7a4bf294-ec47-45b1-91c2-00c966ed1e56 service nova] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-56e8b20e-c87d-4dc2-a0a2-3ca8c150fa73 req-7a4bf294-ec47-45b1-91c2-00c966ed1e56 service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-56e8b20e-c87d-4dc2-a0a2-3ca8c150fa73 req-7a4bf294-ec47-45b1-91c2-00c966ed1e56 service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-56e8b20e-c87d-4dc2-a0a2-3ca8c150fa73 req-7a4bf294-ec47-45b1-91c2-00c966ed1e56 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] No waiting events found dispatching network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:23:58 user nova-compute[72992]: WARNING nova.compute.manager [req-56e8b20e-c87d-4dc2-a0a2-3ca8c150fa73 req-7a4bf294-ec47-45b1-91c2-00c966ed1e56 service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received unexpected event network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 for instance with vm_state building and task_state spawning.
Aug 15 21:23:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lZakxwpO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:23:58 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:23:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:23:58 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:23:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:23:58 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3093a23b-b463-40ff-81b9-75609c380fe2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:23:58 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80227d88-dc4f-4890-af6e-e7fa645890fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22] added
Aug 15 21:23:58 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff30d28c-c9a1-45b0-a658-235e46b611a7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93db23d-bb60-4541-a232-a117f2214142]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lZakxwpO {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lZakxwpO" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6c8cc9-266d-44e0-b16b-c1896a1538aa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lZakxwpO'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01eb2b-a0f7-4759-9e40-0fb6fb7b4b6e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[783eaa6b-e716-473b-bf6c-c9877d5185f8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:23:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:23:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ef1a7e-e44e-497c-9671-fa1e15ca39f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260]
Aug 15 21:23:59 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260] successful.
Aug 15 21:23:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f76c9-6b1d-4119-8acd-0f0c9247e32e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a96542-179d-4d84-9a8c-83a95d5a4eaa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:23:59 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:23:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:23:59 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:23:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a763d21-9cf5-41cb-8c8f-6d7837227413]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:23:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-79bc6972-f37c-4491-8499-48a1078b902e req-dc89b4e8-fda1-4a18-97d2-b40f6934a58a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-79bc6972-f37c-4491-8499-48a1078b902e req-dc89b4e8-fda1-4a18-97d2-b40f6934a58a service nova] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-79bc6972-f37c-4491-8499-48a1078b902e req-dc89b4e8-fda1-4a18-97d2-b40f6934a58a service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-79bc6972-f37c-4491-8499-48a1078b902e req-dc89b4e8-fda1-4a18-97d2-b40f6934a58a service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-79bc6972-f37c-4491-8499-48a1078b902e req-dc89b4e8-fda1-4a18-97d2-b40f6934a58a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] No waiting events found dispatching network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:00 user nova-compute[72992]: WARNING nova.compute.manager [req-79bc6972-f37c-4491-8499-48a1078b902e req-dc89b4e8-fda1-4a18-97d2-b40f6934a58a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received unexpected event network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 for instance with vm_state building and task_state spawning.
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134640.1589315, 5318a1d1-16c0-4b24-b48d-b557c6f061c8 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:24:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] VM Resumed (Lifecycle Event)
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:24:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Instance spawned successfully.
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134640.1631248, 5318a1d1-16c0-4b24-b48d-b557c6f061c8 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:24:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] VM Started (Lifecycle Event)
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:24:00 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:24:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lZakxwpO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23736666632613364', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736666632613364', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'flavor' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:00 user nova-compute[72992]: INFO nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:24:00 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:24:00 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:24:00 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:24:00 user nova-compute[72992]:   <serial>48d2da2a-74cc-4e7a-82a3-1317772a0c22</serial>
Aug 15 21:24:00 user nova-compute[72992]: </disk>
Aug 15 21:24:00 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:24:00 user nova-compute[72992]: INFO nova.compute.manager [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Took 7.31 seconds to build instance.
Aug 15 21:24:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d41ded51-4dd5-4130-b1e8-1160c4690548 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.434s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No VIF found with MAC fa:16:3e:50:ed:9e, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:24:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9aad9cf0-d46d-4cf7-b877-4c58e59d5c1f tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.252s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:24:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:24:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:24:02 user nova-compute[72992]: INFO nova.compute.claims [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Claim successful on node user
Aug 15 21:24:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:02 user nova-compute[72992]: INFO nova.compute.manager [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Rescuing
Aug 15 21:24:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:24:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.121s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:24:03 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.policy [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd12f60b35e7843838c7dcfb4487dee7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b41e38d3f853443ea9f6352679b3240f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:24:03 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Creating image(s)
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "/opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "/opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-9c3cd571-2c57-40dc-bf70-dfa658f8db54 req-51774737-ef42-439f-bf76-42aa909c5a82 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9c3cd571-2c57-40dc-bf70-dfa658f8db54 req-51774737-ef42-439f-bf76-42aa909c5a82 service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9c3cd571-2c57-40dc-bf70-dfa658f8db54 req-51774737-ef42-439f-bf76-42aa909c5a82 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9c3cd571-2c57-40dc-bf70-dfa658f8db54 req-51774737-ef42-439f-bf76-42aa909c5a82 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-9c3cd571-2c57-40dc-bf70-dfa658f8db54 req-51774737-ef42-439f-bf76-42aa909c5a82 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:03 user nova-compute[72992]: WARNING nova.compute.manager [req-9c3cd571-2c57-40dc-bf70-dfa658f8db54 req-51774737-ef42-439f-bf76-42aa909c5a82 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state active and task_state rescuing.
Aug 15 21:24:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.263s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk 1073741824" returned: 0 in 0.070s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance destroyed successfully.
Aug 15 21:24:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Attempting rescue
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72992) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:24:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Creating image(s)
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.225s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Successfully created port: 416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.219s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue" returned: 0 in 0.067s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'migration_context' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Cannot resize image /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'migration_context' on Instance uuid 834d86c4-9546-42fc-a46a-89abefa7c77d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Start _get_guest_xml network_info=[{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:50:ed:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'resources' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Ensure instance console log exists: /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'numa_topology' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:04 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:24:04 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135965252',display_name='tempest-ServerRescueNegativeTestJSON-server-135965252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135965252',id=24,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoG7GLpTZPIOfeTNrohuB6QD35sMMlIjTG5U6PRzFh/AtDn9UGQjcGWYvJfTnSYCuFGyxwI6pFesDQzIamJCfWpCR5fIVkOuj+B9x49Vyzcj8PQs8beXHdOLu3i5X/Fnw==',key_name='tempest-keypair-218307302',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-yqqqodut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a032f1741f46ee814186f61b82aac4',uuid=bf2b214b-f493-476b-bf23-7c13ffb3de87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:50:ed:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "vif_mac": "fa:16:3e:50:ed:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'pci_devices' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:24:04 user nova-compute[72992]:   <uuid>bf2b214b-f493-476b-bf23-7c13ffb3de87</uuid>
Aug 15 21:24:04 user nova-compute[72992]:   <name>instance-00000018</name>
Aug 15 21:24:04 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:24:04 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:24:04 user nova-compute[72992]:   <metadata>
Aug 15 21:24:04 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:24:04 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:24:04 user nova-compute[72992]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-135965252</nova:name>
Aug 15 21:24:04 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:24:04</nova:creationTime>
Aug 15 21:24:04 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:24:04 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:24:04 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:24:04 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:24:04 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:24:04 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:24:04 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:24:04 user nova-compute[72992]:       <nova:owner>
Aug 15 21:24:04 user nova-compute[72992]:         <nova:user uuid="08a032f1741f46ee814186f61b82aac4">tempest-ServerRescueNegativeTestJSON-600517153-project-member</nova:user>
Aug 15 21:24:04 user nova-compute[72992]:         <nova:project uuid="664606f930f446fabae71df899c94da5">tempest-ServerRescueNegativeTestJSON-600517153</nova:project>
Aug 15 21:24:04 user nova-compute[72992]:       </nova:owner>
Aug 15 21:24:04 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:24:04 user nova-compute[72992]:       <nova:ports>
Aug 15 21:24:04 user nova-compute[72992]:         <nova:port uuid="7eb3b13a-2761-4a8c-97cd-1f991ef988be">
Aug 15 21:24:04 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 21:24:04 user nova-compute[72992]:         </nova:port>
Aug 15 21:24:04 user nova-compute[72992]:       </nova:ports>
Aug 15 21:24:04 user nova-compute[72992]:     </nova:instance>
Aug 15 21:24:04 user nova-compute[72992]:   </metadata>
Aug 15 21:24:04 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:24:04 user nova-compute[72992]:     <system>
Aug 15 21:24:04 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:24:04 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:24:04 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:24:04 user nova-compute[72992]:       <entry name="serial">bf2b214b-f493-476b-bf23-7c13ffb3de87</entry>
Aug 15 21:24:04 user nova-compute[72992]:       <entry name="uuid">bf2b214b-f493-476b-bf23-7c13ffb3de87</entry>
Aug 15 21:24:04 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:24:04 user nova-compute[72992]:     </system>
Aug 15 21:24:04 user nova-compute[72992]:   </sysinfo>
Aug 15 21:24:04 user nova-compute[72992]:   <os>
Aug 15 21:24:04 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:24:04 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:24:04 user nova-compute[72992]:   </os>
Aug 15 21:24:04 user nova-compute[72992]:   <features>
Aug 15 21:24:04 user nova-compute[72992]:     <acpi/>
Aug 15 21:24:04 user nova-compute[72992]:     <apic/>
Aug 15 21:24:04 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:24:04 user nova-compute[72992]:   </features>
Aug 15 21:24:04 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:24:04 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:24:04 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:24:04 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:24:04 user nova-compute[72992]:   </clock>
Aug 15 21:24:04 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:24:04 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:24:04 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:24:04 user nova-compute[72992]:   </cpu>
Aug 15 21:24:04 user nova-compute[72992]:   <devices>
Aug 15 21:24:04 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:24:04 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:24:04 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue"/>
Aug 15 21:24:04 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:24:04 user nova-compute[72992]:     </disk>
Aug 15 21:24:04 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:24:04 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:24:04 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk"/>
Aug 15 21:24:04 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:24:04 user nova-compute[72992]:     </disk>
Aug 15 21:24:04 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:24:04 user nova-compute[72992]:       <mac address="fa:16:3e:50:ed:9e"/>
Aug 15 21:24:04 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:24:04 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:24:04 user nova-compute[72992]:       <target dev="tap7eb3b13a-27"/>
Aug 15 21:24:04 user nova-compute[72992]:     </interface>
Aug 15 21:24:04 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:24:04 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/console.log" append="off"/>
Aug 15 21:24:04 user nova-compute[72992]:     </serial>
Aug 15 21:24:04 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:24:04 user nova-compute[72992]:     <video>
Aug 15 21:24:04 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:24:04 user nova-compute[72992]:     </video>
Aug 15 21:24:04 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:24:04 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:24:04 user nova-compute[72992]:     </rng>
Aug 15 21:24:04 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:24:04 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:24:04 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:24:04 user nova-compute[72992]:     </memballoon>
Aug 15 21:24:04 user nova-compute[72992]:   </devices>
Aug 15 21:24:04 user nova-compute[72992]: </domain>
Aug 15 21:24:04 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:24:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance destroyed successfully.
Aug 15 21:24:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:24:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] No VIF found with MAC fa:16:3e:50:ed:9e, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Successfully updated port: 416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquired lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-changed-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Refreshing instance network info cache due to event network-changed-416afd6a-86e3-452e-b5d4-5beddccd91cb. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] Acquiring lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-28aa1bcc-2d72-4407-a616-a438fae433f3 req-8b54f4de-1d43-4093-95d0-5ccefca32efd service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-28aa1bcc-2d72-4407-a616-a438fae433f3 req-8b54f4de-1d43-4093-95d0-5ccefca32efd service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-28aa1bcc-2d72-4407-a616-a438fae433f3 req-8b54f4de-1d43-4093-95d0-5ccefca32efd service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-28aa1bcc-2d72-4407-a616-a438fae433f3 req-8b54f4de-1d43-4093-95d0-5ccefca32efd service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-28aa1bcc-2d72-4407-a616-a438fae433f3 req-8b54f4de-1d43-4093-95d0-5ccefca32efd service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:05 user nova-compute[72992]: WARNING nova.compute.manager [req-28aa1bcc-2d72-4407-a616-a438fae433f3 req-8b54f4de-1d43-4093-95d0-5ccefca32efd service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state active and task_state rescuing.
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Updating instance_info_cache with network_info: [{"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Releasing lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Instance network_info: |[{"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] Acquired lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.network.neutron [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Refreshing network info cache for port 416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Start _get_guest_xml network_info=[{"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:24:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:24:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:24:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482284646',display_name='tempest-AttachVolumeNegativeTest-server-482284646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482284646',id=30,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9NPwtbW5WF3xpnUgjFfCoBF/g3oXhPNTE+iUuymdZYha5qCJXZCxrvOCF3gfABTmlazkY3WB0/ctfX41b47kvWQZJr4+iDjNq9YCQieYsVFsjHPrpmS9LlpEAsS4gYMA==',key_name='tempest-keypair-970170161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-mk0lv6ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=834d86c4-9546-42fc-a46a-89abefa7c77d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4d:5f,bridge_name='br-int',has_traffic_filtering=True,id=416afd6a-86e3-452e-b5d4-5beddccd91cb,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416afd6a-86') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'pci_devices' on Instance uuid 834d86c4-9546-42fc-a46a-89abefa7c77d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:24:06 user nova-compute[72992]:   <uuid>834d86c4-9546-42fc-a46a-89abefa7c77d</uuid>
Aug 15 21:24:06 user nova-compute[72992]:   <name>instance-0000001e</name>
Aug 15 21:24:06 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:24:06 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:24:06 user nova-compute[72992]:   <metadata>
Aug 15 21:24:06 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:24:06 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:24:06 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeNegativeTest-server-482284646</nova:name>
Aug 15 21:24:06 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:24:05</nova:creationTime>
Aug 15 21:24:06 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:24:06 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:24:06 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:24:06 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:24:06 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:24:06 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:24:06 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:24:06 user nova-compute[72992]:       <nova:owner>
Aug 15 21:24:06 user nova-compute[72992]:         <nova:user uuid="d12f60b35e7843838c7dcfb4487dee7d">tempest-AttachVolumeNegativeTest-1657501102-project-member</nova:user>
Aug 15 21:24:06 user nova-compute[72992]:         <nova:project uuid="b41e38d3f853443ea9f6352679b3240f">tempest-AttachVolumeNegativeTest-1657501102</nova:project>
Aug 15 21:24:06 user nova-compute[72992]:       </nova:owner>
Aug 15 21:24:06 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:24:06 user nova-compute[72992]:       <nova:ports>
Aug 15 21:24:06 user nova-compute[72992]:         <nova:port uuid="416afd6a-86e3-452e-b5d4-5beddccd91cb">
Aug 15 21:24:06 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:24:06 user nova-compute[72992]:         </nova:port>
Aug 15 21:24:06 user nova-compute[72992]:       </nova:ports>
Aug 15 21:24:06 user nova-compute[72992]:     </nova:instance>
Aug 15 21:24:06 user nova-compute[72992]:   </metadata>
Aug 15 21:24:06 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:24:06 user nova-compute[72992]:     <system>
Aug 15 21:24:06 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:24:06 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:24:06 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:24:06 user nova-compute[72992]:       <entry name="serial">834d86c4-9546-42fc-a46a-89abefa7c77d</entry>
Aug 15 21:24:06 user nova-compute[72992]:       <entry name="uuid">834d86c4-9546-42fc-a46a-89abefa7c77d</entry>
Aug 15 21:24:06 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:24:06 user nova-compute[72992]:     </system>
Aug 15 21:24:06 user nova-compute[72992]:   </sysinfo>
Aug 15 21:24:06 user nova-compute[72992]:   <os>
Aug 15 21:24:06 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:24:06 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:24:06 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:24:06 user nova-compute[72992]:   </os>
Aug 15 21:24:06 user nova-compute[72992]:   <features>
Aug 15 21:24:06 user nova-compute[72992]:     <acpi/>
Aug 15 21:24:06 user nova-compute[72992]:     <apic/>
Aug 15 21:24:06 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:24:06 user nova-compute[72992]:   </features>
Aug 15 21:24:06 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:24:06 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:24:06 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:24:06 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:24:06 user nova-compute[72992]:   </clock>
Aug 15 21:24:06 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:24:06 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:24:06 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:24:06 user nova-compute[72992]:   </cpu>
Aug 15 21:24:06 user nova-compute[72992]:   <devices>
Aug 15 21:24:06 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:24:06 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:24:06 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk"/>
Aug 15 21:24:06 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:24:06 user nova-compute[72992]:     </disk>
Aug 15 21:24:06 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:24:06 user nova-compute[72992]:       <mac address="fa:16:3e:fa:4d:5f"/>
Aug 15 21:24:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:24:06 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:24:06 user nova-compute[72992]:       <target dev="tap416afd6a-86"/>
Aug 15 21:24:06 user nova-compute[72992]:     </interface>
Aug 15 21:24:06 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:24:06 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/console.log" append="off"/>
Aug 15 21:24:06 user nova-compute[72992]:     </serial>
Aug 15 21:24:06 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:24:06 user nova-compute[72992]:     <video>
Aug 15 21:24:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:24:06 user nova-compute[72992]:     </video>
Aug 15 21:24:06 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:24:06 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:24:06 user nova-compute[72992]:     </rng>
Aug 15 21:24:06 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:24:06 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:24:06 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:24:06 user nova-compute[72992]:     </memballoon>
Aug 15 21:24:06 user nova-compute[72992]:   </devices>
Aug 15 21:24:06 user nova-compute[72992]: </domain>
Aug 15 21:24:06 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482284646',display_name='tempest-AttachVolumeNegativeTest-server-482284646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482284646',id=30,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9NPwtbW5WF3xpnUgjFfCoBF/g3oXhPNTE+iUuymdZYha5qCJXZCxrvOCF3gfABTmlazkY3WB0/ctfX41b47kvWQZJr4+iDjNq9YCQieYsVFsjHPrpmS9LlpEAsS4gYMA==',key_name='tempest-keypair-970170161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-mk0lv6ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=834d86c4-9546-42fc-a46a-89abefa7c77d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4d:5f,bridge_name='br-int',has_traffic_filtering=True,id=416afd6a-86e3-452e-b5d4-5beddccd91cb,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416afd6a-86') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG os_vif [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4d:5f,bridge_name='br-int',has_traffic_filtering=True,id=416afd6a-86e3-452e-b5d4-5beddccd91cb,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416afd6a-86') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap416afd6a-86, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap416afd6a-86, col_values=(('external_ids', {'iface-id': '416afd6a-86e3-452e-b5d4-5beddccd91cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:4d:5f', 'vm-uuid': '834d86c4-9546-42fc-a46a-89abefa7c77d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: INFO os_vif [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4d:5f,bridge_name='br-int',has_traffic_filtering=True,id=416afd6a-86e3-452e-b5d4-5beddccd91cb,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416afd6a-86')
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No VIF found with MAC fa:16:3e:fa:4d:5f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.network.neutron [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Updated VIF entry in instance network info cache for port 416afd6a-86e3-452e-b5d4-5beddccd91cb. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG nova.network.neutron [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Updating instance_info_cache with network_info: [{"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5ee671b8-1d78-4872-aadd-fe6f86e97b0c req-2d8a8737-f82c-4326-92ba-5c25d8a4e839 service nova] Releasing lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:07 user nova-compute[72992]: WARNING nova.compute.manager [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state active and task_state rescuing.
Aug 15 21:24:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:07 user nova-compute[72992]: WARNING nova.compute.manager [req-559ff89e-e2c3-43f3-9b79-a0903b3770cc req-0398f4cd-2c92-4bd7-8004-7b746fe2880f service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state active and task_state rescuing.
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bcc9885-97a8-4511-8863-0388e617addb req-3d337414-b756-4347-bbe9-97c05096caab service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bcc9885-97a8-4511-8863-0388e617addb req-3d337414-b756-4347-bbe9-97c05096caab service nova] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bcc9885-97a8-4511-8863-0388e617addb req-3d337414-b756-4347-bbe9-97c05096caab service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bcc9885-97a8-4511-8863-0388e617addb req-3d337414-b756-4347-bbe9-97c05096caab service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bcc9885-97a8-4511-8863-0388e617addb req-3d337414-b756-4347-bbe9-97c05096caab service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] No waiting events found dispatching network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:08 user nova-compute[72992]: WARNING nova.compute.manager [req-8bcc9885-97a8-4511-8863-0388e617addb req-3d337414-b756-4347-bbe9-97c05096caab service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received unexpected event network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb for instance with vm_state building and task_state spawning.
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:09 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:09 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:09 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-1f13ea65-629e-43ce-882c-d0c3ccc8c709 req-a0b96eff-3a22-4513-8edb-8d4c262948c2 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1f13ea65-629e-43ce-882c-d0c3ccc8c709 req-a0b96eff-3a22-4513-8edb-8d4c262948c2 service nova] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1f13ea65-629e-43ce-882c-d0c3ccc8c709 req-a0b96eff-3a22-4513-8edb-8d4c262948c2 service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1f13ea65-629e-43ce-882c-d0c3ccc8c709 req-a0b96eff-3a22-4513-8edb-8d4c262948c2 service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-1f13ea65-629e-43ce-882c-d0c3ccc8c709 req-a0b96eff-3a22-4513-8edb-8d4c262948c2 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] No waiting events found dispatching network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:10 user nova-compute[72992]: WARNING nova.compute.manager [req-1f13ea65-629e-43ce-882c-d0c3ccc8c709 req-a0b96eff-3a22-4513-8edb-8d4c262948c2 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received unexpected event network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb for instance with vm_state building and task_state spawning.
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134650.510197, 834d86c4-9546-42fc-a46a-89abefa7c77d => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] VM Resumed (Lifecycle Event)
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0a66f08c-070e-4103-8d74-f9ec6dd65bf2 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Instance spawned successfully.
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134650.5148363, 834d86c4-9546-42fc-a46a-89abefa7c77d => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] VM Started (Lifecycle Event)
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for bf2b214b-f493-476b-bf23-7c13ffb3de87 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134650.518816, bf2b214b-f493-476b-bf23-7c13ffb3de87 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] VM Resumed (Lifecycle Event)
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Took 7.25 seconds to spawn the instance on the hypervisor.
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134650.5206287, bf2b214b-f493-476b-bf23-7c13ffb3de87 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] VM Started (Lifecycle Event)
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:24:10 user nova-compute[72992]: INFO nova.compute.manager [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Took 8.89 seconds to build instance.
Aug 15 21:24:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78d2e781-8b08-444e-b481-f7c6b249f067 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.020s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:18 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:24:18 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=6751MB free_disk=25.212303161621094GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bf2b214b-f493-476b-bf23-7c13ffb3de87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e4c3c4b4-960e-4273-b237-97c9c2c86fde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4b290dce-4696-42ab-9b7b-fa36a6812481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance f596ced0-6e95-44bb-961a-76622ff4fbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 834d86c4-9546-42fc-a46a-89abefa7c77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=15GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:24:18 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.105s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:24:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-changed-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Refreshing instance network info cache due to event network-changed-cd332ff7-c934-4172-89cd-4480d3fc5c17. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] Acquiring lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] Acquired lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:24:20 user nova-compute[72992]: DEBUG nova.network.neutron [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Refreshing network info cache for port cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'flavor' on Instance uuid fc8f7c53-16f3-4ebb-9382-cfd6f5601897 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:21 user nova-compute[72992]: INFO nova.compute.manager [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Attaching volume 743f92fb-d15e-4638-bbb7-769fde790573 to /dev/vdb
Aug 15 21:24:21 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5113b52d-2f30-41da-893e-223ce4b70f3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98cab9b-7253-453c-979e-19924612658a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9d91f4-e5c5-4266-8f5b-56e5f2104bc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a0f48d-c40f-4916-adcd-a204a42956a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:24:21 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f1b67-aef4-4c64-93d5-ea19bcbd0315]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updated VIF entry in instance network info cache for port cd332ff7-c934-4172-89cd-4480d3fc5c17. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updating instance_info_cache with network_info: [{"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG os_brick.utils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updating existing volume attachment record: c08786f0-23da-4cea-a040-7e8862bbd8a7 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ea7c2c4d-83c4-4e9e-8378-c64f5c899e90 req-a7ef66b6-4fe5-4011-a012-0957f695a211 service nova] Releasing lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating instance_info_cache with network_info: [{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:24:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:24:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:28 user nova-compute[72992]: INFO nova.compute.manager [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Terminating instance
Aug 15 21:24:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-77a38a5a-77c3-4a60-ac08-1dc8b2f83b2b req-ee47b880-4287-43d9-a2e8-10d0c9c47e7e service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received event network-vif-unplugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-77a38a5a-77c3-4a60-ac08-1dc8b2f83b2b req-ee47b880-4287-43d9-a2e8-10d0c9c47e7e service nova] Acquiring lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-77a38a5a-77c3-4a60-ac08-1dc8b2f83b2b req-ee47b880-4287-43d9-a2e8-10d0c9c47e7e service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-77a38a5a-77c3-4a60-ac08-1dc8b2f83b2b req-ee47b880-4287-43d9-a2e8-10d0c9c47e7e service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-77a38a5a-77c3-4a60-ac08-1dc8b2f83b2b req-ee47b880-4287-43d9-a2e8-10d0c9c47e7e service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] No waiting events found dispatching network-vif-unplugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-77a38a5a-77c3-4a60-ac08-1dc8b2f83b2b req-ee47b880-4287-43d9-a2e8-10d0c9c47e7e service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received event network-vif-unplugged-ea02e54b-436c-4475-8102-08d38c803ef2 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Instance destroyed successfully.
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'resources' on Instance uuid e4c3c4b4-960e-4273-b237-97c9c2c86fde {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1061586829',display_name='tempest-VolumesAdminNegativeTest-server-1061586829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1061586829',id=25,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cf00e7b97164c9ea0527545062823ca',ramdisk_id='',reservation_id='r-51d8neiq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1128814075',owner_user_name='tempest-VolumesAdminNegativeTest-1128814075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:22:38Z,user_data=None,user_id='501fc2d9f61e4b60aaa6b9fad0ef3029',uuid=e4c3c4b4-960e-4273-b237-97c9c2c86fde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converting VIF {"id": "ea02e54b-436c-4475-8102-08d38c803ef2", "address": "fa:16:3e:4c:54:7a", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea02e54b-43", "ovs_interfaceid": "ea02e54b-436c-4475-8102-08d38c803ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea02e54b-436c-4475-8102-08d38c803ef2,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02e54b-43') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG os_vif [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea02e54b-436c-4475-8102-08d38c803ef2,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02e54b-43') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea02e54b-43, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:29 user nova-compute[72992]: INFO os_vif [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=ea02e54b-436c-4475-8102-08d38c803ef2,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea02e54b-43')
Aug 15 21:24:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Deleting instance files /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde_del
Aug 15 21:24:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Deletion of /opt/stack/data/nova/instances/e4c3c4b4-960e-4273-b237-97c9c2c86fde_del complete
Aug 15 21:24:29 user nova-compute[72992]: INFO nova.compute.manager [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 15 21:24:29 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:29 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Took 0.57 seconds to deallocate network for instance.
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-cc199751-2320-4428-a7e3-55f48de2aaea req-3da79634-7882-4943-8366-8ae3a5fdc8f5 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received event network-vif-deleted-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:29 user nova-compute[72992]: INFO nova.compute.manager [req-cc199751-2320-4428-a7e3-55f48de2aaea req-3da79634-7882-4943-8366-8ae3a5fdc8f5 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Neutron deleted interface ea02e54b-436c-4475-8102-08d38c803ef2; detaching it from the instance and deleting it from the info cache
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-cc199751-2320-4428-a7e3-55f48de2aaea req-3da79634-7882-4943-8366-8ae3a5fdc8f5 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-cc199751-2320-4428-a7e3-55f48de2aaea req-3da79634-7882-4943-8366-8ae3a5fdc8f5 service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Detach interface failed, port_id=ea02e54b-436c-4475-8102-08d38c803ef2, reason: Instance e4c3c4b4-960e-4273-b237-97c9c2c86fde could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:30 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:24:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:24:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:30 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Deleted allocations for instance e4c3c4b4-960e-4273-b237-97c9c2c86fde
Aug 15 21:24:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7b32cd05-07a6-40ee-b06b-434dc6554743 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-f7e9f3a0-09a0-468d-bdd0-811dde1440ce req-77206c89-2334-4f9b-a561-2fc9a6186aaf service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received event network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f7e9f3a0-09a0-468d-bdd0-811dde1440ce req-77206c89-2334-4f9b-a561-2fc9a6186aaf service nova] Acquiring lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f7e9f3a0-09a0-468d-bdd0-811dde1440ce req-77206c89-2334-4f9b-a561-2fc9a6186aaf service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f7e9f3a0-09a0-468d-bdd0-811dde1440ce req-77206c89-2334-4f9b-a561-2fc9a6186aaf service nova] Lock "e4c3c4b4-960e-4273-b237-97c9c2c86fde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-f7e9f3a0-09a0-468d-bdd0-811dde1440ce req-77206c89-2334-4f9b-a561-2fc9a6186aaf service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] No waiting events found dispatching network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:24:31 user nova-compute[72992]: WARNING nova.compute.manager [req-f7e9f3a0-09a0-468d-bdd0-811dde1440ce req-77206c89-2334-4f9b-a561-2fc9a6186aaf service nova] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Received unexpected event network-vif-plugged-ea02e54b-436c-4475-8102-08d38c803ef2 for instance with vm_state deleted and task_state None.
Aug 15 21:24:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTNIbXRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:24:31 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:24:31 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:24:31 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[79317469-5c17-4664-8cb1-5cd9adff6fb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:24:31 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dcb38e-8435-42de-aba4-e68be6e60993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573] added
Aug 15 21:24:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a02365a-6464-42f8-b285-13d1dd7bc09a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d7a709-36f3-4a8a-878d-d15269125097]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTNIbXRs {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTNIbXRs" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a8bbc-ab33-47ba-8ef3-ddfd3a9d58f9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTNIbXRs'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1051bda8-8750-49fc-8dcd-cecd0c4f3461]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ba8607-5711-4603-9331-8bf6257fa11b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d736236-c9c7-4008-9d00-f689ad2b73a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260]
Aug 15 21:24:31 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260] successful.
Aug 15 21:24:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c9b9ba-57e1-4603-8061-bb3deed59bcd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd84032-22e1-4522-ac93-074bfefb4bfc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 (non-flash)
Aug 15 21:24:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c70212a-2d82-484c-9025-399e02b6e0fe]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTNIbXRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23335373934316336', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373934316336', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'flavor' on Instance uuid fc8f7c53-16f3-4ebb-9382-cfd6f5601897 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:24:32 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:24:32 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:24:32 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:24:32 user nova-compute[72992]:   <serial>743f92fb-d15e-4638-bbb7-769fde790573</serial>
Aug 15 21:24:32 user nova-compute[72992]: </disk>
Aug 15 21:24:32 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:24:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:24:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:24:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] No VIF found with MAC fa:16:3e:e7:ba:7a, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:24:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5e19d500-99a2-4c42-9394-65f319c0c420 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.876s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:35 user nova-compute[72992]: INFO nova.compute.manager [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Detaching volume 743f92fb-d15e-4638-bbb7-769fde790573
Aug 15 21:24:35 user nova-compute[72992]: INFO nova.virt.block_device [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Attempting to driver detach volume 743f92fb-d15e-4638-bbb7-769fde790573 from mountpoint /dev/vdb
Aug 15 21:24:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Attempting to detach device vdb from instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:24:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:24:35 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:24:35 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:24:35 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:24:35 user nova-compute[72992]:   <serial>743f92fb-d15e-4638-bbb7-769fde790573</serial>
Aug 15 21:24:35 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:24:35 user nova-compute[72992]: </disk>
Aug 15 21:24:35 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:24:35 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully detached device vdb from instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 from the persistent domain config.
Aug 15 21:24:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:24:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:24:35 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:24:35 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:24:35 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:24:35 user nova-compute[72992]:   <serial>743f92fb-d15e-4638-bbb7-769fde790573</serial>
Aug 15 21:24:35 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:24:35 user nova-compute[72992]: </disk>
Aug 15 21:24:35 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134676.13363, fc8f7c53-16f3-4ebb-9382-cfd6f5601897 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:24:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully detached device vdb from instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 from the live domain config.
Aug 15 21:24:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTNIbXRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:24:36 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[34546e65-9024-4e25-8aa9-33201c6345e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d404a-aba6-4172-93dd-e321b7dd6f37]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:24:36 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:24:36 user nova-compute[72992]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 (non-flash)
Aug 15 21:24:36 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:24:36 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:24:36 user nova-compute[72992]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 (non-flash)
Aug 15 21:24:36 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c7eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9be2eb-3973-4114-8a7e-ffde62b5f10c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1085b1dd-6ecd-4be9-95ca-692da8eaa3fa]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e66aa99-594c-4e4c-b9cf-4c8d9bc8b468]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d462c-f313-4c14-a5ea-756727870161]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa98e5ce-8254-4055-9405-487818b2be8c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f079b4a-430f-495f-8e34-9042f0ebdd91]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260]
Aug 15 21:24:36 user nova-compute[72992]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573, portal: 172.16.0.220,3260] successful.
Aug 15 21:24:36 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743f92fb-d15e-4638-bbb7-769fde790573 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a867a8-145e-49eb-ae0d-fc3f20b12f97]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] <== disconnect_volume: return (268ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:24:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:24:37 user nova-compute[72992]: DEBUG nova.objects.instance [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'flavor' on Instance uuid fc8f7c53-16f3-4ebb-9382-cfd6f5601897 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:24:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-76a62101-304a-42d4-a2ae-839ea802209e tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.521s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:44 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134669.2487917, e4c3c4b4-960e-4273-b237-97c9c2c86fde => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:24:44 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] VM Stopped (Lifecycle Event)
Aug 15 21:24:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e3b8e4ad-0876-4e52-87ab-14366407f050 None None] [instance: e4c3c4b4-960e-4273-b237-97c9c2c86fde] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:24:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:24:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:24:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:24:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:24:48 user nova-compute[72992]: INFO nova.compute.claims [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Claim successful on node user
Aug 15 21:24:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:24:49 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:24:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:24:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:24:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:24:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:24:49 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:24:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:24:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:24:49 user nova-compute[72992]: INFO nova.virt.block_device [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Booting with volume-backed-image ca16bfd3-6680-457d-af6e-aad43cd3fadd at /dev/vda
Aug 15 21:24:49 user nova-compute[72992]: DEBUG nova.policy [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96dac56448a242a7817193b06d3ac23f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d4659b5fec441f894388f4379fb182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Successfully created port: c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Successfully updated port: c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-changed-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Refreshing instance network info cache due to event network-changed-c4083799-faf5-41d9-9893-64913d8f1da8. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:24:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] Acquiring lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updating instance_info_cache with network_info: [{"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance network_info: |[{"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] Acquired lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Refreshing network info cache for port c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updated VIF entry in instance network info cache for port c4083799-faf5-41d9-9893-64913d8f1da8. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updating instance_info_cache with network_info: [{"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:24:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b777db32-f3e8-4b18-9c68-a1dcb649012a req-5565a976-4d59-486c-9698-6954938ee28a service nova] Releasing lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:24:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:24:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG os_brick.utils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e390fb-1859-4b2a-bbd6-da1ea1801c81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70ae038-d147-48d4-bfe1-249ca047615c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a1109c-0cf3-48cf-83e0-2b51ea54e02a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[42451b13-24b0-4fa3-b0d3-9a901ef1a697]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:25:00 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:25:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac3c5a3-ff44-43fe-a9da-ed04c5df557e]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG os_brick.utils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:25:00 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updating existing volume attachment record: 0c46b755-9eed-4558-ac4e-b616fdef48b6 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:25:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:25:04 user nova-compute[72992]: INFO nova.compute.claims [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Claim successful on node user
Aug 15 21:25:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:25:05 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.policy [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9192e3fb208c401190105a465161ad70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386bc7deac3d4d57ae29c8461335ca0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:25:05 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Creating image(s)
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk 1073741824" returned: 0 in 0.053s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Successfully created port: 4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Cannot resize image /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.objects.instance [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'migration_context' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Ensure instance console log exists: /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Successfully updated port: 4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquired lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-changed-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Refreshing instance network info cache due to event network-changed-4fa2e308-85c4-436b-b95f-1a795bf5d172. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] Acquiring lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updating instance_info_cache with network_info: [{"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Releasing lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance network_info: |[{"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] Acquired lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.network.neutron [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Refreshing network info cache for port 4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Start _get_guest_xml network_info=[{"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:25:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:25:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:25:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-163271747',display_name='tempest-tempest.common.compute-instance-163271747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-163271747',id=32,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7bXwqMZIeNK/UPVfgL9RBymsbyZftqvthPDwEQWg/QwX2g2qv9Afjk892Qem4fCOitU+U1TDUSyRlNpSysiMh7xI3FONPSgI7IEFlYLIBEMi/wIfR0wMz+VOL+ZMfgg==',key_name='tempest-keypair-2092967577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-50bw7bpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=aa27d011-e6f9-4a7c-9d06-6633aa933094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'pci_devices' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:25:07 user nova-compute[72992]:   <uuid>aa27d011-e6f9-4a7c-9d06-6633aa933094</uuid>
Aug 15 21:25:07 user nova-compute[72992]:   <name>instance-00000020</name>
Aug 15 21:25:07 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:25:07 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:25:07 user nova-compute[72992]:   <metadata>
Aug 15 21:25:07 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:25:07 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:25:07 user nova-compute[72992]:       <nova:name>tempest-tempest.common.compute-instance-163271747</nova:name>
Aug 15 21:25:07 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:25:06</nova:creationTime>
Aug 15 21:25:07 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:25:07 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:25:07 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:25:07 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:25:07 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:25:07 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:25:07 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:25:07 user nova-compute[72992]:       <nova:owner>
Aug 15 21:25:07 user nova-compute[72992]:         <nova:user uuid="9192e3fb208c401190105a465161ad70">tempest-ServerActionsTestOtherA-752735396-project-member</nova:user>
Aug 15 21:25:07 user nova-compute[72992]:         <nova:project uuid="386bc7deac3d4d57ae29c8461335ca0e">tempest-ServerActionsTestOtherA-752735396</nova:project>
Aug 15 21:25:07 user nova-compute[72992]:       </nova:owner>
Aug 15 21:25:07 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:25:07 user nova-compute[72992]:       <nova:ports>
Aug 15 21:25:07 user nova-compute[72992]:         <nova:port uuid="4fa2e308-85c4-436b-b95f-1a795bf5d172">
Aug 15 21:25:07 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 21:25:07 user nova-compute[72992]:         </nova:port>
Aug 15 21:25:07 user nova-compute[72992]:       </nova:ports>
Aug 15 21:25:07 user nova-compute[72992]:     </nova:instance>
Aug 15 21:25:07 user nova-compute[72992]:   </metadata>
Aug 15 21:25:07 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:25:07 user nova-compute[72992]:     <system>
Aug 15 21:25:07 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:25:07 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:25:07 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:25:07 user nova-compute[72992]:       <entry name="serial">aa27d011-e6f9-4a7c-9d06-6633aa933094</entry>
Aug 15 21:25:07 user nova-compute[72992]:       <entry name="uuid">aa27d011-e6f9-4a7c-9d06-6633aa933094</entry>
Aug 15 21:25:07 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:25:07 user nova-compute[72992]:     </system>
Aug 15 21:25:07 user nova-compute[72992]:   </sysinfo>
Aug 15 21:25:07 user nova-compute[72992]:   <os>
Aug 15 21:25:07 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:25:07 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:25:07 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:25:07 user nova-compute[72992]:   </os>
Aug 15 21:25:07 user nova-compute[72992]:   <features>
Aug 15 21:25:07 user nova-compute[72992]:     <acpi/>
Aug 15 21:25:07 user nova-compute[72992]:     <apic/>
Aug 15 21:25:07 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:25:07 user nova-compute[72992]:   </features>
Aug 15 21:25:07 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:25:07 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:25:07 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:25:07 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:25:07 user nova-compute[72992]:   </clock>
Aug 15 21:25:07 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:25:07 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:25:07 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:25:07 user nova-compute[72992]:   </cpu>
Aug 15 21:25:07 user nova-compute[72992]:   <devices>
Aug 15 21:25:07 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:25:07 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:25:07 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk"/>
Aug 15 21:25:07 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:25:07 user nova-compute[72992]:     </disk>
Aug 15 21:25:07 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:25:07 user nova-compute[72992]:       <mac address="fa:16:3e:f6:1d:55"/>
Aug 15 21:25:07 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:25:07 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:25:07 user nova-compute[72992]:       <target dev="tap4fa2e308-85"/>
Aug 15 21:25:07 user nova-compute[72992]:     </interface>
Aug 15 21:25:07 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:25:07 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/console.log" append="off"/>
Aug 15 21:25:07 user nova-compute[72992]:     </serial>
Aug 15 21:25:07 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:25:07 user nova-compute[72992]:     <video>
Aug 15 21:25:07 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:25:07 user nova-compute[72992]:     </video>
Aug 15 21:25:07 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:25:07 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:25:07 user nova-compute[72992]:     </rng>
Aug 15 21:25:07 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:25:07 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:25:07 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:25:07 user nova-compute[72992]:     </memballoon>
Aug 15 21:25:07 user nova-compute[72992]:   </devices>
Aug 15 21:25:07 user nova-compute[72992]: </domain>
Aug 15 21:25:07 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-163271747',display_name='tempest-tempest.common.compute-instance-163271747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-163271747',id=32,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7bXwqMZIeNK/UPVfgL9RBymsbyZftqvthPDwEQWg/QwX2g2qv9Afjk892Qem4fCOitU+U1TDUSyRlNpSysiMh7xI3FONPSgI7IEFlYLIBEMi/wIfR0wMz+VOL+ZMfgg==',key_name='tempest-keypair-2092967577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-50bw7bpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:25:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=aa27d011-e6f9-4a7c-9d06-6633aa933094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG os_vif [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fa2e308-85, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fa2e308-85, col_values=(('external_ids', {'iface-id': '4fa2e308-85c4-436b-b95f-1a795bf5d172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:1d:55', 'vm-uuid': 'aa27d011-e6f9-4a7c-9d06-6633aa933094'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:07 user nova-compute[72992]: INFO os_vif [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85')
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No VIF found with MAC fa:16:3e:f6:1d:55, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.network.neutron [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updated VIF entry in instance network info cache for port 4fa2e308-85c4-436b-b95f-1a795bf5d172. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG nova.network.neutron [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updating instance_info_cache with network_info: [{"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-275c447d-0527-4637-9172-49090dfcfe2d req-7e060cb7-fa37-4914-8a49-5042822b562f service nova] Releasing lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-96c35a91-a2ee-4e42-b3b7-e1f854f8ad03 req-08fc59d9-5f38-46c8-b530-e43598845b86 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-96c35a91-a2ee-4e42-b3b7-e1f854f8ad03 req-08fc59d9-5f38-46c8-b530-e43598845b86 service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-96c35a91-a2ee-4e42-b3b7-e1f854f8ad03 req-08fc59d9-5f38-46c8-b530-e43598845b86 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-96c35a91-a2ee-4e42-b3b7-e1f854f8ad03 req-08fc59d9-5f38-46c8-b530-e43598845b86 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-96c35a91-a2ee-4e42-b3b7-e1f854f8ad03 req-08fc59d9-5f38-46c8-b530-e43598845b86 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:08 user nova-compute[72992]: WARNING nova.compute.manager [req-96c35a91-a2ee-4e42-b3b7-e1f854f8ad03 req-08fc59d9-5f38-46c8-b530-e43598845b86 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received unexpected event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with vm_state building and task_state spawning.
Aug 15 21:25:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:25:09 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Creating image(s)
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Ensure instance console log exists: /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Start _get_guest_xml network_info=[{"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'injEeoyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9', 'attached_at': '', 'detached_at': '', 'volume_id': '9da17aa4-252a-4007-80b3-fcc03437952a', 'serial': '9da17aa4-252a-4007-80b3-fcc03437952a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '0c46b755-9eed-4558-ac4e-b616fdef48b6', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:25:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:25:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'injEeoyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:25:09 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:25:09 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:25:09 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4552e51-6e1d-431f-811f-6e2fd8fd8b59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:25:09 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c975934c-e6d2-4be7-92e5-8e0b1fb55898]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a] added
Aug 15 21:25:09 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8fa36e-8192-4dc7-b30d-2ebcefe02567]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1340c5e4-3f25-4211-b12f-bc5ebd5971c5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v injEeoyF {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v injEeoyF" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[11149495-21b3-4048-80bc-bba85335144e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'injEeoyF'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fcb163-a8f6-49a2-8055-2650bf433386]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c8ff7b-d769-4450-976a-b31d6e3f5063]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4165d808-a7c9-4a68-a4e2-7133f3cf0a69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260]
Aug 15 21:25:09 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260] successful.
Aug 15 21:25:09 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6710d6a1-0304-4c14-94b1-b59b228eab7a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[19097d4e-959f-4a3a-80ae-df95675a261f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:25:09 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:09 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:25:09 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:25:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edb6cd5-e20b-4c16-947c-d42e8eb8c277]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'injEeoyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-23e1d2b0-7867-4546-b195-c4ec910a820c req-42d9ae90-083e-4585-baf0-cc238386888b service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-23e1d2b0-7867-4546-b195-c4ec910a820c req-42d9ae90-083e-4585-baf0-cc238386888b service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-23e1d2b0-7867-4546-b195-c4ec910a820c req-42d9ae90-083e-4585-baf0-cc238386888b service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-23e1d2b0-7867-4546-b195-c4ec910a820c req-42d9ae90-083e-4585-baf0-cc238386888b service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-23e1d2b0-7867-4546-b195-c4ec910a820c req-42d9ae90-083e-4585-baf0-cc238386888b service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:10 user nova-compute[72992]: WARNING nova.compute.manager [req-23e1d2b0-7867-4546-b195-c4ec910a820c req-42d9ae90-083e-4585-baf0-cc238386888b service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received unexpected event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with vm_state building and task_state spawning.
Aug 15 21:25:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134710.7674763, aa27d011-e6f9-4a7c-9d06-6633aa933094 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] VM Resumed (Lifecycle Event)
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:25:10 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance spawned successfully.
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134710.7676635, aa27d011-e6f9-4a7c-9d06-6633aa933094 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] VM Started (Lifecycle Event)
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:25:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:25:10 user nova-compute[72992]: INFO nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 15 21:25:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:10 user nova-compute[72992]: INFO nova.compute.manager [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Took 6.64 seconds to build instance.
Aug 15 21:25:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-eec1b06d-694a-468f-9af2-5bdacdb6cafa tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.753s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23938356562663334', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938356562663334', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219868108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219868108',id=31,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-ish0ghuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:24:50Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'pci_devices' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:25:11 user nova-compute[72992]:   <uuid>e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9</uuid>
Aug 15 21:25:11 user nova-compute[72992]:   <name>instance-0000001f</name>
Aug 15 21:25:11 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:25:11 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:25:11 user nova-compute[72992]:   <metadata>
Aug 15 21:25:11 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:25:11 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:25:11 user nova-compute[72992]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1219868108</nova:name>
Aug 15 21:25:11 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:25:09</nova:creationTime>
Aug 15 21:25:11 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:25:11 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:25:11 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:25:11 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:25:11 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:25:11 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:25:11 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:25:11 user nova-compute[72992]:       <nova:owner>
Aug 15 21:25:11 user nova-compute[72992]:         <nova:user uuid="96dac56448a242a7817193b06d3ac23f">tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member</nova:user>
Aug 15 21:25:11 user nova-compute[72992]:         <nova:project uuid="c0d4659b5fec441f894388f4379fb182">tempest-ServerBootFromVolumeStableRescueTest-47310148</nova:project>
Aug 15 21:25:11 user nova-compute[72992]:       </nova:owner>
Aug 15 21:25:11 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:25:11 user nova-compute[72992]:       <nova:ports>
Aug 15 21:25:11 user nova-compute[72992]:         <nova:port uuid="c4083799-faf5-41d9-9893-64913d8f1da8">
Aug 15 21:25:11 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 21:25:11 user nova-compute[72992]:         </nova:port>
Aug 15 21:25:11 user nova-compute[72992]:       </nova:ports>
Aug 15 21:25:11 user nova-compute[72992]:     </nova:instance>
Aug 15 21:25:11 user nova-compute[72992]:   </metadata>
Aug 15 21:25:11 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:25:11 user nova-compute[72992]:     <system>
Aug 15 21:25:11 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:25:11 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:25:11 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:25:11 user nova-compute[72992]:       <entry name="serial">e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9</entry>
Aug 15 21:25:11 user nova-compute[72992]:       <entry name="uuid">e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9</entry>
Aug 15 21:25:11 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:25:11 user nova-compute[72992]:     </system>
Aug 15 21:25:11 user nova-compute[72992]:   </sysinfo>
Aug 15 21:25:11 user nova-compute[72992]:   <os>
Aug 15 21:25:11 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:25:11 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:25:11 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:25:11 user nova-compute[72992]:   </os>
Aug 15 21:25:11 user nova-compute[72992]:   <features>
Aug 15 21:25:11 user nova-compute[72992]:     <acpi/>
Aug 15 21:25:11 user nova-compute[72992]:     <apic/>
Aug 15 21:25:11 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:25:11 user nova-compute[72992]:   </features>
Aug 15 21:25:11 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:25:11 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:25:11 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:25:11 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:25:11 user nova-compute[72992]:   </clock>
Aug 15 21:25:11 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:25:11 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:25:11 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:25:11 user nova-compute[72992]:   </cpu>
Aug 15 21:25:11 user nova-compute[72992]:   <devices>
Aug 15 21:25:11 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:25:11 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:25:11 user nova-compute[72992]:       <source dev="/dev/sdd"/>
Aug 15 21:25:11 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:25:11 user nova-compute[72992]:       <serial>9da17aa4-252a-4007-80b3-fcc03437952a</serial>
Aug 15 21:25:11 user nova-compute[72992]:     </disk>
Aug 15 21:25:11 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:25:11 user nova-compute[72992]:       <mac address="fa:16:3e:73:f8:45"/>
Aug 15 21:25:11 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:25:11 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:25:11 user nova-compute[72992]:       <target dev="tapc4083799-fa"/>
Aug 15 21:25:11 user nova-compute[72992]:     </interface>
Aug 15 21:25:11 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:25:11 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/console.log" append="off"/>
Aug 15 21:25:11 user nova-compute[72992]:     </serial>
Aug 15 21:25:11 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:25:11 user nova-compute[72992]:     <video>
Aug 15 21:25:11 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:25:11 user nova-compute[72992]:     </video>
Aug 15 21:25:11 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:25:11 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:25:11 user nova-compute[72992]:     </rng>
Aug 15 21:25:11 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:25:11 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:25:11 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:25:11 user nova-compute[72992]:     </memballoon>
Aug 15 21:25:11 user nova-compute[72992]:   </devices>
Aug 15 21:25:11 user nova-compute[72992]: </domain>
Aug 15 21:25:11 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219868108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219868108',id=31,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-ish0ghuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:24:50Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG os_vif [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4083799-fa, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4083799-fa, col_values=(('external_ids', {'iface-id': 'c4083799-faf5-41d9-9893-64913d8f1da8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:f8:45', 'vm-uuid': 'e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:11 user nova-compute[72992]: INFO os_vif [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa')
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No VIF found with MAC fa:16:3e:73:f8:45, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:11 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-63e3aedd-f018-43b0-9c79-c5c027dccc89 req-f56b4899-eeac-425b-81cf-fcb92ed8cd16 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63e3aedd-f018-43b0-9c79-c5c027dccc89 req-f56b4899-eeac-425b-81cf-fcb92ed8cd16 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63e3aedd-f018-43b0-9c79-c5c027dccc89 req-f56b4899-eeac-425b-81cf-fcb92ed8cd16 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63e3aedd-f018-43b0-9c79-c5c027dccc89 req-f56b4899-eeac-425b-81cf-fcb92ed8cd16 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-63e3aedd-f018-43b0-9c79-c5c027dccc89 req-f56b4899-eeac-425b-81cf-fcb92ed8cd16 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:12 user nova-compute[72992]: WARNING nova.compute.manager [req-63e3aedd-f018-43b0-9c79-c5c027dccc89 req-f56b4899-eeac-425b-81cf-fcb92ed8cd16 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state building and task_state spawning.
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134714.6992788, e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:14 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] VM Resumed (Lifecycle Event)
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:14 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance spawned successfully.
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:25:14 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134714.700893, e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:14 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] VM Started (Lifecycle Event)
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-0ffa7ee9-a840-41d9-aff1-e0151508ebd3 req-4cca5efe-f9ae-476d-b1d5-bebd9230cde4 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0ffa7ee9-a840-41d9-aff1-e0151508ebd3 req-4cca5efe-f9ae-476d-b1d5-bebd9230cde4 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0ffa7ee9-a840-41d9-aff1-e0151508ebd3 req-4cca5efe-f9ae-476d-b1d5-bebd9230cde4 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0ffa7ee9-a840-41d9-aff1-e0151508ebd3 req-4cca5efe-f9ae-476d-b1d5-bebd9230cde4 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [req-0ffa7ee9-a840-41d9-aff1-e0151508ebd3 req-4cca5efe-f9ae-476d-b1d5-bebd9230cde4 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:14 user nova-compute[72992]: WARNING nova.compute.manager [req-0ffa7ee9-a840-41d9-aff1-e0151508ebd3 req-4cca5efe-f9ae-476d-b1d5-bebd9230cde4 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state building and task_state spawning.
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:25:14 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:14 user nova-compute[72992]: INFO nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 15 21:25:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:15 user nova-compute[72992]: INFO nova.compute.manager [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Took 26.17 seconds to build instance.
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1f9ed839-f14b-46c2-87dc-5563e12601b3 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.254s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-changed-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Refreshing instance network info cache due to event network-changed-e4038664-f682-4738-afe1-42891cbda0c6. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] Acquiring lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] Acquired lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG nova.network.neutron [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Refreshing network info cache for port e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG nova.network.neutron [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updated VIF entry in instance network info cache for port e4038664-f682-4738-afe1-42891cbda0c6. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG nova.network.neutron [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating instance_info_cache with network_info: [{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aeba4a5-a78a-4906-9408-7dbea9c5bcfe req-cf5a529e-1b97-4c14-a6f5-2a8fb3a19ea2 service nova] Releasing lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:20 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:25:20 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=6657MB free_disk=25.17176055908203GB free_vcpus=-5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bf2b214b-f493-476b-bf23-7c13ffb3de87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4b290dce-4696-42ab-9b7b-fa36a6812481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance f596ced0-6e95-44bb-961a-76622ff4fbf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 834d86c4-9546-42fc-a46a-89abefa7c77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance aa27d011-e6f9-4a7c-9d06-6633aa933094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:25:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=15GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:25:21 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:25:21 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:25:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:21 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:25:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:23 user nova-compute[72992]: INFO nova.compute.manager [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Shelving
Aug 15 21:25:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-9b1453c3-8b12-4e4d-b06b-876b3b009566 req-8178317e-2835-4215-864e-a5e36d462c8f service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-unplugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9b1453c3-8b12-4e4d-b06b-876b3b009566 req-8178317e-2835-4215-864e-a5e36d462c8f service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9b1453c3-8b12-4e4d-b06b-876b3b009566 req-8178317e-2835-4215-864e-a5e36d462c8f service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9b1453c3-8b12-4e4d-b06b-876b3b009566 req-8178317e-2835-4215-864e-a5e36d462c8f service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-9b1453c3-8b12-4e4d-b06b-876b3b009566 req-8178317e-2835-4215-864e-a5e36d462c8f service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-unplugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:23 user nova-compute[72992]: WARNING nova.compute.manager [req-9b1453c3-8b12-4e4d-b06b-876b3b009566 req-8178317e-2835-4215-864e-a5e36d462c8f service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received unexpected event network-vif-unplugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with vm_state active and task_state shelving.
Aug 15 21:25:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance destroyed successfully.
Aug 15 21:25:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Beginning cold snapshot process
Aug 15 21:25:23 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:25:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk /opt/stack/data/nova/instances/snapshots/tmpujp_xwze/dd57542b2c3346b3b4c80de874b123d2 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:25:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:24 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:25:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk /opt/stack/data/nova/instances/snapshots/tmpujp_xwze/dd57542b2c3346b3b4c80de874b123d2" returned: 0 in 0.825s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:24 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Snapshot extracted, beginning image upload
Aug 15 21:25:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating instance_info_cache with network_info: [{"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-8742d2a3-f2d8-483a-96c9-b32c3dfb5c20 req-e19d1179-973b-432c-a058-ff974545da69 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8742d2a3-f2d8-483a-96c9-b32c3dfb5c20 req-e19d1179-973b-432c-a058-ff974545da69 service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8742d2a3-f2d8-483a-96c9-b32c3dfb5c20 req-e19d1179-973b-432c-a058-ff974545da69 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8742d2a3-f2d8-483a-96c9-b32c3dfb5c20 req-e19d1179-973b-432c-a058-ff974545da69 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-8742d2a3-f2d8-483a-96c9-b32c3dfb5c20 req-e19d1179-973b-432c-a058-ff974545da69 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:25 user nova-compute[72992]: WARNING nova.compute.manager [req-8742d2a3-f2d8-483a-96c9-b32c3dfb5c20 req-e19d1179-973b-432c-a058-ff974545da69 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received unexpected event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:25 user nova-compute[72992]: INFO nova.compute.manager [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Terminating instance
Aug 15 21:25:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-9689df14-98f0-475d-bacf-13a287fa6f58 req-add4dac7-95e8-4891-9893-f742adcd2624 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-vif-unplugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9689df14-98f0-475d-bacf-13a287fa6f58 req-add4dac7-95e8-4891-9893-f742adcd2624 service nova] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9689df14-98f0-475d-bacf-13a287fa6f58 req-add4dac7-95e8-4891-9893-f742adcd2624 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9689df14-98f0-475d-bacf-13a287fa6f58 req-add4dac7-95e8-4891-9893-f742adcd2624 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-9689df14-98f0-475d-bacf-13a287fa6f58 req-add4dac7-95e8-4891-9893-f742adcd2624 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] No waiting events found dispatching network-vif-unplugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-9689df14-98f0-475d-bacf-13a287fa6f58 req-add4dac7-95e8-4891-9893-f742adcd2624 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-vif-unplugged-6db66a63-bcd4-4b52-91bf-3d800b701102 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:25:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Instance destroyed successfully.
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lazy-loading 'resources' on Instance uuid 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2056642060',display_name='tempest-VolumesAdminNegativeTest-server-2056642060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2056642060',id=19,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9tzRYo+6fjeEBvCEf2YJUHE3I3vY0dUUfgnuH5rAEYRssh2j7+e+ZXIbQmdTKUmEjaN8ZSkAzsvx1tYi3oz86xdP1qSiGfUg9/0uIJXXSLDYGoIDHZDMZlr02JEFXZtw==',key_name='tempest-keypair-580252258',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cf00e7b97164c9ea0527545062823ca',ramdisk_id='',reservation_id='r-d2tnun34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1128814075',owner_user_name='tempest-VolumesAdminNegativeTest-1128814075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='501fc2d9f61e4b60aaa6b9fad0ef3029',uuid=79f18fe8-67d4-44f2-95c7-ad93ec3f11c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converting VIF {"id": "6db66a63-bcd4-4b52-91bf-3d800b701102", "address": "fa:16:3e:3b:f1:5b", "network": {"id": "c31ca816-59dc-461d-906a-6d01d51d4bb9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-911901205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cf00e7b97164c9ea0527545062823ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db66a63-bc", "ovs_interfaceid": "6db66a63-bcd4-4b52-91bf-3d800b701102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6db66a63-bcd4-4b52-91bf-3d800b701102,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db66a63-bc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG os_vif [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6db66a63-bcd4-4b52-91bf-3d800b701102,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db66a63-bc') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6db66a63-bc, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:26 user nova-compute[72992]: INFO os_vif [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f1:5b,bridge_name='br-int',has_traffic_filtering=True,id=6db66a63-bcd4-4b52-91bf-3d800b701102,network=Network(c31ca816-59dc-461d-906a-6d01d51d4bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db66a63-bc')
Aug 15 21:25:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Deleting instance files /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6_del
Aug 15 21:25:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Deletion of /opt/stack/data/nova/instances/79f18fe8-67d4-44f2-95c7-ad93ec3f11c6_del complete
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-changed-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Refreshing instance network info cache due to event network-changed-cd332ff7-c934-4172-89cd-4480d3fc5c17. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] Acquiring lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] Acquired lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.network.neutron [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Refreshing network info cache for port cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:25:26 user nova-compute[72992]: INFO nova.compute.manager [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:26 user nova-compute[72992]: INFO nova.compute.manager [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Terminating instance
Aug 15 21:25:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "f596ced0-6e95-44bb-961a-76622ff4fbf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:27 user nova-compute[72992]: INFO nova.compute.manager [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Terminating instance
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Instance destroyed successfully.
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'resources' on Instance uuid fc8f7c53-16f3-4ebb-9382-cfd6f5601897 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-424204253',display_name='tempest-TestStampPattern-server-424204253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-424204253',id=26,image_ref='df8a5392-5f70-402a-a85b-33c85532b112',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ9LQPzLnABcv71N9nYVWL+Fn/RdNmnzmuhnw6hO4OzBLkxgpbGKUob3hEumkbgp7aK0Sa2W4LWJ91yJuRehLK1Oo45fCKFQi/ADJDWYyb1i99bkbDTJmf0wrBW4+wheg==',key_name='tempest-TestStampPattern-46122809',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:22:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3407b4e631e745479767ab32173a57f9',ramdisk_id='',reservation_id='r-gpsp9x4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5023ba98-b30a-4362-a183-7366a52d0feb',image_min_disk='1',image_min_ram='0',image_owner_id='3407b4e631e745479767ab32173a57f9',image_owner_project_name='tempest-TestStampPattern-2084179488',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2084179488-project-member',image_user_id='f9781f9aa2f141d8a96849d4c90dd553',owner_project_name='tempest-TestStampPattern-2084179488',owner_user_name='tempest-TestStampPattern-2084179488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:22:39Z,user_data=None,user_id='f9781f9aa2f141d8a96849d4c90dd553',uuid=fc8f7c53-16f3-4ebb-9382-cfd6f5601897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converting VIF {"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:ba:7a,bridge_name='br-int',has_traffic_filtering=True,id=cd332ff7-c934-4172-89cd-4480d3fc5c17,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd332ff7-c9') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG os_vif [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:ba:7a,bridge_name='br-int',has_traffic_filtering=True,id=cd332ff7-c934-4172-89cd-4480d3fc5c17,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd332ff7-c9') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd332ff7-c9, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:27 user nova-compute[72992]: INFO os_vif [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:ba:7a,bridge_name='br-int',has_traffic_filtering=True,id=cd332ff7-c934-4172-89cd-4480d3fc5c17,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd332ff7-c9')
Aug 15 21:25:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Deleting instance files /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897_del
Aug 15 21:25:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Deletion of /opt/stack/data/nova/instances/fc8f7c53-16f3-4ebb-9382-cfd6f5601897_del complete
Aug 15 21:25:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Snapshot image upload complete
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:27 user nova-compute[72992]: INFO nova.compute.manager [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 15 21:25:27 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:25:27 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:25:27 user nova-compute[72992]: INFO nova.compute.manager [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Shelve offloading
Aug 15 21:25:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance destroyed successfully.
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Instance destroyed successfully.
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lazy-loading 'resources' on Instance uuid f596ced0-6e95-44bb-961a-76622ff4fbf8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquired lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-420436157',display_name='tempest-ServersNegativeTestJSON-server-420436157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-420436157',id=28,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:23:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='012f4eadf36d411ab5f9f38ae8910e33',ramdisk_id='',reservation_id='r-xju7bw48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-827890923',owner_user_name='tempest-ServersNegativeTestJSON-827890923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:23:45Z,user_data=None,user_id='7d9bab564e134919a835eb6c932e3c7b',uuid=f596ced0-6e95-44bb-961a-76622ff4fbf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converting VIF {"id": "6006e89b-7652-4276-97fa-eecea3ce77ec", "address": "fa:16:3e:8d:93:40", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6006e89b-76", "ovs_interfaceid": "6006e89b-7652-4276-97fa-eecea3ce77ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:93:40,bridge_name='br-int',has_traffic_filtering=True,id=6006e89b-7652-4276-97fa-eecea3ce77ec,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6006e89b-76') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG os_vif [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:93:40,bridge_name='br-int',has_traffic_filtering=True,id=6006e89b-7652-4276-97fa-eecea3ce77ec,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6006e89b-76') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6006e89b-76, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:28 user nova-compute[72992]: INFO os_vif [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:93:40,bridge_name='br-int',has_traffic_filtering=True,id=6006e89b-7652-4276-97fa-eecea3ce77ec,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6006e89b-76')
Aug 15 21:25:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Deleting instance files /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8_del
Aug 15 21:25:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Deletion of /opt/stack/data/nova/instances/f596ced0-6e95-44bb-961a-76622ff4fbf8_del complete
Aug 15 21:25:28 user nova-compute[72992]: INFO nova.compute.manager [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-1e45b435-e9f5-4f6d-a5b2-3599af2a6e12 req-01eb82de-cc52-422d-94f2-42818f49f1d0 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1e45b435-e9f5-4f6d-a5b2-3599af2a6e12 req-01eb82de-cc52-422d-94f2-42818f49f1d0 service nova] Acquiring lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1e45b435-e9f5-4f6d-a5b2-3599af2a6e12 req-01eb82de-cc52-422d-94f2-42818f49f1d0 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1e45b435-e9f5-4f6d-a5b2-3599af2a6e12 req-01eb82de-cc52-422d-94f2-42818f49f1d0 service nova] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-1e45b435-e9f5-4f6d-a5b2-3599af2a6e12 req-01eb82de-cc52-422d-94f2-42818f49f1d0 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] No waiting events found dispatching network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:28 user nova-compute[72992]: WARNING nova.compute.manager [req-1e45b435-e9f5-4f6d-a5b2-3599af2a6e12 req-01eb82de-cc52-422d-94f2-42818f49f1d0 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received unexpected event network-vif-plugged-6db66a63-bcd4-4b52-91bf-3d800b701102 for instance with vm_state active and task_state deleting.
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updated VIF entry in instance network info cache for port cd332ff7-c934-4172-89cd-4480d3fc5c17. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updating instance_info_cache with network_info: [{"id": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "address": "fa:16:3e:e7:ba:7a", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd332ff7-c9", "ovs_interfaceid": "cd332ff7-c934-4172-89cd-4480d3fc5c17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-21e33dc9-660f-4427-9e56-0ffda5c0f8a5 req-44c0fd2b-4181-4335-81f0-f39bc5604088 service nova] Releasing lock "refresh_cache-fc8f7c53-16f3-4ebb-9382-cfd6f5601897" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-vif-unplugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] No waiting events found dispatching network-vif-unplugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-vif-unplugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Acquiring lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] No waiting events found dispatching network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:28 user nova-compute[72992]: WARNING nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received unexpected event network-vif-plugged-cd332ff7-c934-4172-89cd-4480d3fc5c17 for instance with vm_state active and task_state deleting.
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received event network-vif-unplugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Acquiring lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] No waiting events found dispatching network-vif-unplugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received event network-vif-unplugged-6006e89b-7652-4276-97fa-eecea3ce77ec for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received event network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Acquiring lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] No waiting events found dispatching network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:28 user nova-compute[72992]: WARNING nova.compute.manager [req-72764ae5-9b29-4463-88ce-9b3cb4e76cd3 req-0b14bf98-5969-4550-9e38-a6ed373f3b89 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received unexpected event network-vif-plugged-6006e89b-7652-4276-97fa-eecea3ce77ec for instance with vm_state active and task_state deleting.
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:28 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Took 0.66 seconds to deallocate network for instance.
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:29 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Deleted allocations for instance f596ced0-6e95-44bb-961a-76622ff4fbf8
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating instance_info_cache with network_info: [{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Releasing lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d74cda7-2b98-4020-95d9-0ce5e4134ccf tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "f596ced0-6e95-44bb-961a-76622ff4fbf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:29 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Took 3.03 seconds to deallocate network for instance.
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-9d3928f4-619b-46b5-9d02-ff7cb533b57f req-81b2d87b-ec59-4e8d-a412-c5570a22a1a6 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Received event network-vif-deleted-6db66a63-bcd4-4b52-91bf-3d800b701102 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:29 user nova-compute[72992]: INFO nova.compute.manager [req-9d3928f4-619b-46b5-9d02-ff7cb533b57f req-81b2d87b-ec59-4e8d-a412-c5570a22a1a6 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Neutron deleted interface 6db66a63-bcd4-4b52-91bf-3d800b701102; detaching it from the instance and deleting it from the info cache
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-9d3928f4-619b-46b5-9d02-ff7cb533b57f req-81b2d87b-ec59-4e8d-a412-c5570a22a1a6 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:29 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Took 1.91 seconds to deallocate network for instance.
Aug 15 21:25:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-9d3928f4-619b-46b5-9d02-ff7cb533b57f req-81b2d87b-ec59-4e8d-a412-c5570a22a1a6 service nova] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Detach interface failed, port_id=6db66a63-bcd4-4b52-91bf-3d800b701102, reason: Instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.450s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance destroyed successfully.
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'resources' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819635464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819635464',id=27,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbZznfDDGD0iZIucT6QHthsMyTBp+iA4rK6C3Vo5rzePxuQwULUvNhbFZLK1Q2Dy7XO1TMTfA4CVUIoMgfaQNS+A4I4GY1atSalYH+J29ji0QmsjasrLCyTLhFBp7RBQ==',key_name='tempest-keypair-903603687',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-4tuo9m5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member',shelved_at='2023-08-15T21:25:27.866729',shelved_host='user',shelved_image_id='a77f5747-1d50-4ea9-9fe2-fe89d31a3df7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:25:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=4b290dce-4696-42ab-9b7b-fa36a6812481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG os_vif [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4038664-f6, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:25:30 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Deleted allocations for instance 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6
Aug 15 21:25:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:25:30 user nova-compute[72992]: INFO os_vif [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6')
Aug 15 21:25:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Deleting instance files /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481_del
Aug 15 21:25:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Deletion of /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481_del complete
Aug 15 21:25:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d216d3b2-bd2d-4775-9fa5-f208464f3354 tempest-VolumesAdminNegativeTest-1128814075 tempest-VolumesAdminNegativeTest-1128814075-project-member] Lock "79f18fe8-67d4-44f2-95c7-ad93ec3f11c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.733s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:30 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Deleted allocations for instance 4b290dce-4696-42ab-9b7b-fa36a6812481
Aug 15 21:25:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-e79d0561-04ba-44da-a778-98520606f3cd req-18a4901d-198f-4033-a396-a127aa8f1fe5 service nova] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Received event network-vif-deleted-6006e89b-7652-4276-97fa-eecea3ce77ec {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.259s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:30 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:30 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Deleted allocations for instance fc8f7c53-16f3-4ebb-9382-cfd6f5601897
Aug 15 21:25:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a588af83-646e-4489-90ec-bc6a87750b57 tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "fc8f7c53-16f3-4ebb-9382-cfd6f5601897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.238s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:31 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:25:31 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:25:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9c428b6d-dd18-48da-8e5d-557ca3e42301 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.253s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-6fc1a299-4923-4729-8ad2-1707e3cb0b8e req-69219d2e-c04f-42aa-9311-2c877d11d5ae service nova] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Received event network-vif-deleted-cd332ff7-c934-4172-89cd-4480d3fc5c17 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:38 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134723.7323349, 4b290dce-4696-42ab-9b7b-fa36a6812481 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:38 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] VM Stopped (Lifecycle Event)
Aug 15 21:25:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b6e16d7f-9527-47c1-a452-eadb4b8732bf None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:41 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134726.58512, 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:41 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] VM Stopped (Lifecycle Event)
Aug 15 21:25:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4ddf798b-03b8-4e62-b72b-339d99db47a8 None None] [instance: 79f18fe8-67d4-44f2-95c7-ad93ec3f11c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:42 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134727.6125593, fc8f7c53-16f3-4ebb-9382-cfd6f5601897 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:42 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] VM Stopped (Lifecycle Event)
Aug 15 21:25:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0dff07b9-55b8-4e3b-b063-835b9d8cc2e6 None None] [instance: fc8f7c53-16f3-4ebb-9382-cfd6f5601897] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:43 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134728.050143, f596ced0-6e95-44bb-961a-76622ff4fbf8 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:43 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] VM Stopped (Lifecycle Event)
Aug 15 21:25:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-af495056-99f3-414a-af7c-baab0021a33d None None] [instance: f596ced0-6e95-44bb-961a-76622ff4fbf8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-changed-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Refreshing instance network info cache due to event network-changed-25d7d1e7-b900-43a8-b497-cddd93d7b252. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:25:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] Acquiring lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] Acquired lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Refreshing network info cache for port 25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:25:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updated VIF entry in instance network info cache for port 25d7d1e7-b900-43a8-b497-cddd93d7b252. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:25:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updating instance_info_cache with network_info: [{"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1d9527fc-cc45-41c0-aa5a-1e2de0044b0d req-f0549bff-ac77-4033-9af4-ff21b5fb934d service nova] Releasing lock "refresh_cache-5318a1d1-16c0-4b24-b48d-b557c6f061c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:47 user nova-compute[72992]: INFO nova.compute.manager [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Attaching volume 3b33abad-d2dc-4e1a-872d-9a0fc822014c to /dev/vdb
Aug 15 21:25:47 user nova-compute[72992]: DEBUG os_brick.utils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90665d-8081-4b5b-ae61-6610ab6eb445]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b589c7c-de77-47d0-9076-c798d721c628]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1b0503-f5d0-4142-8ab8-972e4f026489]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[82591d6b-1a63-4602-8c5a-133e5ee0f578]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:25:48 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:25:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955a1b0-8a30-4f1b-bd52-169000e42484]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG os_brick.utils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:25:48 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updating existing volume attachment record: 6c90e1a0-ff96-4cd1-bc30-b0d7bb39f34d {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:25:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-changed-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Refreshing instance network info cache due to event network-changed-416afd6a-86e3-452e-b5d4-5beddccd91cb. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:25:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] Acquiring lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] Acquired lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:53 user nova-compute[72992]: DEBUG nova.network.neutron [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Refreshing network info cache for port 416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:25:53 user nova-compute[72992]: INFO nova.compute.manager [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Unrescuing
Aug 15 21:25:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:25:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquired lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:25:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Updated VIF entry in instance network info cache for port 416afd6a-86e3-452e-b5d4-5beddccd91cb. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Updating instance_info_cache with network_info: [{"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cc8fef20-73d0-4890-8ca4-97fe7e428a2c req-9c94d0a6-009f-4204-b42c-d6457f7dd79d service nova] Releasing lock "refresh_cache-834d86c4-9546-42fc-a46a-89abefa7c77d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Releasing lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'flavor' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG nova.compute.manager [req-18ec512e-c9df-4489-b8de-79fa3c2a2a31 req-8e43d52d-f568-43a4-9b56-2a9a48c9a6c9 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-18ec512e-c9df-4489-b8de-79fa3c2a2a31 req-8e43d52d-f568-43a4-9b56-2a9a48c9a6c9 service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-18ec512e-c9df-4489-b8de-79fa3c2a2a31 req-8e43d52d-f568-43a4-9b56-2a9a48c9a6c9 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-18ec512e-c9df-4489-b8de-79fa3c2a2a31 req-8e43d52d-f568-43a4-9b56-2a9a48c9a6c9 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG nova.compute.manager [req-18ec512e-c9df-4489-b8de-79fa3c2a2a31 req-8e43d52d-f568-43a4-9b56-2a9a48c9a6c9 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:54 user nova-compute[72992]: WARNING nova.compute.manager [req-18ec512e-c9df-4489-b8de-79fa3c2a2a31 req-8e43d52d-f568-43a4-9b56-2a9a48c9a6c9 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:25:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance destroyed successfully.
Aug 15 21:25:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:57 user nova-compute[72992]: WARNING nova.compute.manager [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:25:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:57 user nova-compute[72992]: WARNING nova.compute.manager [req-b1b212be-5c80-4114-93cd-deefaca3b4ed req-0102e4e6-9359-4cef-acf2-845ac30bd3af service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid 834d86c4-9546-42fc-a46a-89abefa7c77d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:57 user nova-compute[72992]: INFO nova.compute.manager [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Attaching volume eab388bb-8d65-4c61-a0f3-1978b1dd1798 to /dev/vdb
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.utils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9575f008-8427-4fa8-b2ba-bc919faf333e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3886255b-c01c-4a42-9204-2f173903bb28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda0cd58-c67e-40d8-aaed-9cec64263608]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fcce74-e83f-4fc6-ac5b-f15f2a79ed19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqMcwjyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:25:57 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:25:57 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:25:57 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:25:57 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe9cd3-9d8a-4c77-8558-a04807c8c308]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.utils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Updating existing volume attachment record: 123d2f78-7b26-4376-909f-bc8d3a33efaa {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f00922b-a76f-4319-be78-885632b9bf53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:25:57 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c3140f-342c-46c6-8d6c-cdce6e589c94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c] added
Aug 15 21:25:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa33761-c2c6-473f-aba1-3a3f5cd7869a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a9f3b7-e176-42d6-a7eb-baabbd56a23e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqMcwjyS {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqMcwjyS" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eae404-d79d-4c79-9740-81870a66e125]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lqMcwjyS'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9321ff0a-f70f-489d-a6c2-604452340e6e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d28736-c6cc-4f13-88b3-571878fc88a0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:25:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:25:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ede07f-cbd9-4e81-98b2-62677805776b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260]
Aug 15 21:25:57 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260] successful.
Aug 15 21:25:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c735929e-7452-4689-a945-4e54d6f3669f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5890d739-56bb-42b4-b41d-6caa314c72d5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:25:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:25:57 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:25:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[02833db7-690d-4ad4-9684-0a7fb4baa510]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:25:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for bf2b214b-f493-476b-bf23-7c13ffb3de87 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134758.753369, bf2b214b-f493-476b-bf23-7c13ffb3de87 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:58 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] VM Resumed (Lifecycle Event)
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e22078ce-a06a-48ca-af4b-97606a866021 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:25:58 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134758.755526, bf2b214b-f493-476b-bf23-7c13ffb3de87 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:25:58 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] VM Started (Lifecycle Event)
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqMcwjyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26330326438376362', 'path': '/dev/sde'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330326438376362', 'path': '/dev/sde'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:25:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:25:58 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:25:58 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:25:58 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:25:58 user nova-compute[72992]:   <serial>3b33abad-d2dc-4e1a-872d-9a0fc822014c</serial>
Aug 15 21:25:58 user nova-compute[72992]: </disk>
Aug 15 21:25:58 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-f22ef099-1d3c-4c7c-809a-405f2f3f8465 req-0b9f6e0f-c4ed-4168-8225-3f93a16361c7 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f22ef099-1d3c-4c7c-809a-405f2f3f8465 req-0b9f6e0f-c4ed-4168-8225-3f93a16361c7 service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f22ef099-1d3c-4c7c-809a-405f2f3f8465 req-0b9f6e0f-c4ed-4168-8225-3f93a16361c7 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f22ef099-1d3c-4c7c-809a-405f2f3f8465 req-0b9f6e0f-c4ed-4168-8225-3f93a16361c7 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-f22ef099-1d3c-4c7c-809a-405f2f3f8465 req-0b9f6e0f-c4ed-4168-8225-3f93a16361c7 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:25:59 user nova-compute[72992]: WARNING nova.compute.manager [req-f22ef099-1d3c-4c7c-809a-405f2f3f8465 req-0b9f6e0f-c4ed-4168-8225-3f93a16361c7 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state active and task_state None.
Aug 15 21:25:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No VIF found with MAC fa:16:3e:c2:09:cd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:25:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9d08b8aa-73ea-4ad2-a50a-15ec3772b1c6 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.584s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG nova.objects.instance [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:03 user nova-compute[72992]: INFO nova.compute.manager [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Attaching volume 59ca0456-d6a4-4c86-a581-009cea7d6416 to /dev/vdc
Aug 15 21:26:03 user nova-compute[72992]: DEBUG os_brick.utils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d99e3-1d90-46ab-afb9-dc170d7f0eb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614d748-d0cc-4faf-8c78-2c1299946b09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a684824-3820-414c-8f13-8f9aa4495503]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c41c97-5051-4363-8fba-881c0d46de09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:26:03 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:26:03 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0643596b-3609-4f0d-b3a3-e05581e7ed65]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG os_brick.utils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:03 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updating existing volume attachment record: 258aa79f-7735-4eac-a7d3-38e75a7ed279 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:26:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diBFovLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:07 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:07 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:07 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb2c31-5a1d-407f-a1f2-6230a5439f70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:26:07 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[370ec57a-b687-4aeb-a018-2ec9aba835b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798] added
Aug 15 21:26:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[491eedc8-1e35-440b-ac42-ee40fae0b050]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b481229-134a-48cb-a718-aca33f780dad]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v diBFovLU {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v diBFovLU" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0400d20b-1082-4786-8286-3410e2372aba]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'diBFovLU'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3787a0b-1cbc-45f3-96da-c74022a14cdd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a06ebf-627d-4803-97fc-47af6c3d1b2b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[535b34d6-8d03-4ce2-9973-ec954289f5de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260]
Aug 15 21:26:07 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260] successful.
Aug 15 21:26:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[be07ab05-8832-4684-a8a1-f4b67c6280f0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[56de9a84-141a-4b69-86e0-b1ecfd667b17]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:07 user nova-compute[72992]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 (non-flash)
Aug 15 21:26:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0444c3-8b4e-490e-a446-503f4f170d99]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:26:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diBFovLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:26:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26330396633646361', 'path': '/dev/sdf'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330396633646361', 'path': '/dev/sdf'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:26:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid 834d86c4-9546-42fc-a46a-89abefa7c77d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:26:08 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:08 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:26:08 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:26:08 user nova-compute[72992]:   <serial>eab388bb-8d65-4c61-a0f3-1978b1dd1798</serial>
Aug 15 21:26:08 user nova-compute[72992]: </disk>
Aug 15 21:26:08 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:26:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:26:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:26:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] No VIF found with MAC fa:16:3e:fa:4d:5f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:26:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c3c7ab4d-9520-4797-b6c0-2f1d15d1073e tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.042s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:09 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:10 user nova-compute[72992]: INFO nova.compute.manager [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Detaching volume eab388bb-8d65-4c61-a0f3-1978b1dd1798
Aug 15 21:26:10 user nova-compute[72992]: INFO nova.virt.block_device [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Attempting to driver detach volume eab388bb-8d65-4c61-a0f3-1978b1dd1798 from mountpoint /dev/vdb
Aug 15 21:26:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Attempting to detach device vdb from instance 834d86c4-9546-42fc-a46a-89abefa7c77d from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:26:10 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:10 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:26:10 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:26:10 user nova-compute[72992]:   <serial>eab388bb-8d65-4c61-a0f3-1978b1dd1798</serial>
Aug 15 21:26:10 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:26:10 user nova-compute[72992]: </disk>
Aug 15 21:26:10 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:26:10 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully detached device vdb from instance 834d86c4-9546-42fc-a46a-89abefa7c77d from the persistent domain config.
Aug 15 21:26:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 834d86c4-9546-42fc-a46a-89abefa7c77d from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:26:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:26:10 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:10 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:26:10 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:26:10 user nova-compute[72992]:   <serial>eab388bb-8d65-4c61-a0f3-1978b1dd1798</serial>
Aug 15 21:26:10 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:26:10 user nova-compute[72992]: </disk>
Aug 15 21:26:10 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134771.3080676, 834d86c4-9546-42fc-a46a-89abefa7c77d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 834d86c4-9546-42fc-a46a-89abefa7c77d {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:26:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully detached device vdb from instance 834d86c4-9546-42fc-a46a-89abefa7c77d from the live domain config.
Aug 15 21:26:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'diBFovLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:11 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1762014-952e-4bc8-9676-896d2238415f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8dcaa9-cb5d-4c4e-b71e-725716512581]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 (non-flash)
Aug 15 21:26:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:11 user nova-compute[72992]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 (non-flash)
Aug 15 21:26:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c88264280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798'): ({'sdf'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Removing single pathed devices sdf {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b972ec2e-7203-4922-ad87-7ab1b9e56fb6]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dcfa9f-8a14-4dc4-bc68-528c687e7f83]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Flushing IO for device /dev/sdf {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb5f6b-e62d-4d33-9bc6-7c23074def0f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c79b1f-5ff6-4eeb-9002-b52d8de6c995]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2280fb1-2e0f-4544-ade2-ab1997b5dca6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83ceef-29b0-4443-8d8a-291729b79d6c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260]
Aug 15 21:26:11 user nova-compute[72992]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798, portal: 172.16.0.220,3260] successful.
Aug 15 21:26:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eab388bb-8d65-4c61-a0f3-1978b1dd1798 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2ee38-b4b0-45fc-b531-302611185089]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] <== disconnect_volume: return (317ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:26:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:12 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'flavor' on Instance uuid 834d86c4-9546-42fc-a46a-89abefa7c77d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5b894594-aed9-4cd3-bbd3-15857d25b183 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.859s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDoHlxqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:13 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:13 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:13 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3483a57-353c-4982-8a15-d0ace9793b0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:26:13 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[db42cdb9-f862-48dd-9e78-be739d4261b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416] added
Aug 15 21:26:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[af143f20-4575-4401-a0ce-2f90a93d151f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4efa3a9-ce7e-4519-8f47-a3a825085325]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDoHlxqc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDoHlxqc" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f9e33-ba8b-4d91-a31e-0a00297664d0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KDoHlxqc'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1119a14-2829-443e-aaeb-5ffa9d980330]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b404dc-9b3d-446b-b768-47b8a8a23895]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[92433ec2-3363-4d55-9fa1-83ec1fbfe2e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260]
Aug 15 21:26:14 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260] successful.
Aug 15 21:26:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3bfe7f-957f-4be6-b460-aaa742e0a7fa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[046225df-75d7-49ca-94a8-ce932835a6e7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:14 user nova-compute[72992]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)
Aug 15 21:26:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d26509c-2d7f-4374-aeae-a79527fc8a87]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDoHlxqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23135353761643638', 'path': '/dev/sdf'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135353761643638', 'path': '/dev/sdf'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.objects.instance [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:26:15 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:15 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:26:15 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:26:15 user nova-compute[72992]:   <serial>59ca0456-d6a4-4c86-a581-009cea7d6416</serial>
Aug 15 21:26:15 user nova-compute[72992]: </disk>
Aug 15 21:26:15 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] No VIF found with MAC fa:16:3e:c2:09:cd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-14ea8f60-3da1-41ea-96b1-e49bd47d386d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.207s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:17 user nova-compute[72992]: INFO nova.compute.manager [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Detaching volume 3b33abad-d2dc-4e1a-872d-9a0fc822014c
Aug 15 21:26:17 user nova-compute[72992]: INFO nova.virt.block_device [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Attempting to driver detach volume 3b33abad-d2dc-4e1a-872d-9a0fc822014c from mountpoint /dev/vdb
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Attempting to detach device vdb from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:26:17 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:17 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:26:17 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:26:17 user nova-compute[72992]:   <serial>3b33abad-d2dc-4e1a-872d-9a0fc822014c</serial>
Aug 15 21:26:17 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:26:17 user nova-compute[72992]: </disk>
Aug 15 21:26:17 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:26:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully detached device vdb from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the persistent domain config.
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:26:17 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:17 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:26:17 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:26:17 user nova-compute[72992]:   <serial>3b33abad-d2dc-4e1a-872d-9a0fc822014c</serial>
Aug 15 21:26:17 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:26:17 user nova-compute[72992]: </disk>
Aug 15 21:26:17 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134777.6021445, 5318a1d1-16c0-4b24-b48d-b557c6f061c8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:26:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully detached device vdb from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the live domain config.
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqMcwjyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:17 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c28d39a-1359-4493-8c62-d11d163d3567]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7152c49-c99a-4a65-a142-570f5cee1ca9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)
Aug 15 21:26:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c (non-flash)
Aug 15 21:26:17 user nova-compute[72992]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)
Aug 15 21:26:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c884dd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c'): ({'sde'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Removing single pathed devices sde {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89c8a79-b9e5-4acb-9ff6-88e37c45e0ff]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6aa85-7734-4f57-8f19-bd11a096086c]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flushing IO for device /dev/sde {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf359a12-7063-4bf5-aa6c-3e6c3d7c3ad9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7d42bb-c1cb-497b-8383-86a6f5dbdf65]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f0bfd4-b608-4929-acd2-d8d391a52420]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af6d1a-0608-42a7-9528-adce02654e44]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260]
Aug 15 21:26:17 user nova-compute[72992]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c, portal: 172.16.0.220,3260] successful.
Aug 15 21:26:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b33abad-d2dc-4e1a-872d-9a0fc822014c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[400cd006-b2d8-408b-a00c-c28a18f842a3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== disconnect_volume: return (356ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:26:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:19 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:26:19 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7059MB free_disk=25.176544189453125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-710c8e4b-5f43-4f28-93b6-bab41cdd664d tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.117s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5023ba98-b30a-4362-a183-7366a52d0feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bf2b214b-f493-476b-bf23-7c13ffb3de87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 834d86c4-9546-42fc-a46a-89abefa7c77d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance aa27d011-e6f9-4a7c-9d06-6633aa933094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:19 user nova-compute[72992]: INFO nova.compute.manager [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Detaching volume 59ca0456-d6a4-4c86-a581-009cea7d6416
Aug 15 21:26:19 user nova-compute[72992]: INFO nova.virt.block_device [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Attempting to driver detach volume 59ca0456-d6a4-4c86-a581-009cea7d6416 from mountpoint /dev/vdc
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Attempting to detach device vdc from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:26:19 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:19 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:26:19 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:26:19 user nova-compute[72992]:   <serial>59ca0456-d6a4-4c86-a581-009cea7d6416</serial>
Aug 15 21:26:19 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 21:26:19 user nova-compute[72992]: </disk>
Aug 15 21:26:19 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:26:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully detached device vdc from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the persistent domain config.
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:26:19 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:19 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:26:19 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:26:19 user nova-compute[72992]:   <serial>59ca0456-d6a4-4c86-a581-009cea7d6416</serial>
Aug 15 21:26:19 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 21:26:19 user nova-compute[72992]: </disk>
Aug 15 21:26:19 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134780.0736506, 5318a1d1-16c0-4b24-b48d-b557c6f061c8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:26:20 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully detached device vdc from instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8 from the live domain config.
Aug 15 21:26:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDoHlxqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:20 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[33526095-970b-4370-b958-c029e4a26788]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[89791ad4-b569-48fe-83d8-cd17633c91bc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:20 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:20 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:20 user nova-compute[72992]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)
Aug 15 21:26:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:20 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:20 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:20 user nova-compute[72992]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 (non-flash)
Aug 15 21:26:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c1b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416'): ({'sdf'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Removing single pathed devices sdf {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e48a361-4f86-41d4-8360-87e462b991d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabf1011-27d0-475f-a094-754faa30912b]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Flushing IO for device /dev/sdf {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb5cafb-97d2-44e7-ae78-25f94cd42bea]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cd84b4-0f49-4786-b1ac-13b84604fdab]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80915e47-de63-46b2-9bca-3bddd39d5017]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f01730-0c68-4228-8fd6-3c2b6527f312]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260]
Aug 15 21:26:20 user nova-compute[72992]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416, portal: 172.16.0.220,3260] successful.
Aug 15 21:26:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca0456-d6a4-4c86-a581-009cea7d6416 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3ff260-8ac7-442b-a04d-f12ff47563a4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] <== disconnect_volume: return (303ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:26:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'flavor' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-ed682dba-c7bf-4905-9852-0b4058c7d11f tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.665s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:26:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:22 user nova-compute[72992]: INFO nova.compute.manager [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Terminating instance
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.compute.manager [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-0ea48524-86dd-40e5-933e-73468218113e req-ea984de0-f6bc-4c7d-a8e9-55f23b88967a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-vif-unplugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0ea48524-86dd-40e5-933e-73468218113e req-ea984de0-f6bc-4c7d-a8e9-55f23b88967a service nova] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0ea48524-86dd-40e5-933e-73468218113e req-ea984de0-f6bc-4c7d-a8e9-55f23b88967a service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0ea48524-86dd-40e5-933e-73468218113e req-ea984de0-f6bc-4c7d-a8e9-55f23b88967a service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-0ea48524-86dd-40e5-933e-73468218113e req-ea984de0-f6bc-4c7d-a8e9-55f23b88967a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] No waiting events found dispatching network-vif-unplugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-0ea48524-86dd-40e5-933e-73468218113e req-ea984de0-f6bc-4c7d-a8e9-55f23b88967a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-vif-unplugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:26:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Instance destroyed successfully.
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lazy-loading 'resources' on Instance uuid 5318a1d1-16c0-4b24-b48d-b557c6f061c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:23:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-567564830',display_name='tempest-AttachVolumeTestJSON-server-567564830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-567564830',id=29,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSLRpXuqjYYtP1uVhFAVnNzW6FduooU7SgFkza/5He3GphVVf1ayukoyreYGOZ7HWVVHjgdnQO+JVHA30+nK8e5RxY41ATelbjeCecYqGYuXYu1fuf/ZRwQvxFFxgsGRA==',key_name='tempest-keypair-1544559500',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b55df905a9e64949ac35075fb206991e',ramdisk_id='',reservation_id='r-scqaiybo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2136218087',owner_user_name='tempest-AttachVolumeTestJSON-2136218087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6ff1260094b492086d5ae874ed7dd0d',uuid=5318a1d1-16c0-4b24-b48d-b557c6f061c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converting VIF {"id": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "address": "fa:16:3e:c2:09:cd", "network": {"id": "c5ddbc50-2032-4226-a076-1013d257b6ae", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-767011868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b55df905a9e64949ac35075fb206991e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25d7d1e7-b9", "ovs_interfaceid": "25d7d1e7-b900-43a8-b497-cddd93d7b252", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:09:cd,bridge_name='br-int',has_traffic_filtering=True,id=25d7d1e7-b900-43a8-b497-cddd93d7b252,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d7d1e7-b9') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG os_vif [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:09:cd,bridge_name='br-int',has_traffic_filtering=True,id=25d7d1e7-b900-43a8-b497-cddd93d7b252,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d7d1e7-b9') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25d7d1e7-b9, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:26:22 user nova-compute[72992]: INFO os_vif [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:09:cd,bridge_name='br-int',has_traffic_filtering=True,id=25d7d1e7-b900-43a8-b497-cddd93d7b252,network=Network(c5ddbc50-2032-4226-a076-1013d257b6ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25d7d1e7-b9')
Aug 15 21:26:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Deleting instance files /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8_del
Aug 15 21:26:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Deletion of /opt/stack/data/nova/instances/5318a1d1-16c0-4b24-b48d-b557c6f061c8_del complete
Aug 15 21:26:23 user nova-compute[72992]: INFO nova.compute.manager [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 21:26:23 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:26:23 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:26:23 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:26:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:26:24 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Took 1.26 seconds to deallocate network for instance.
Aug 15 21:26:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-2e266c66-dbc3-45f4-a5ce-ed0c3312d344 req-61bd88b3-9655-4ecf-83a5-f8cf0c75f50a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2e266c66-dbc3-45f4-a5ce-ed0c3312d344 req-61bd88b3-9655-4ecf-83a5-f8cf0c75f50a service nova] Acquiring lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2e266c66-dbc3-45f4-a5ce-ed0c3312d344 req-61bd88b3-9655-4ecf-83a5-f8cf0c75f50a service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2e266c66-dbc3-45f4-a5ce-ed0c3312d344 req-61bd88b3-9655-4ecf-83a5-f8cf0c75f50a service nova] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-2e266c66-dbc3-45f4-a5ce-ed0c3312d344 req-61bd88b3-9655-4ecf-83a5-f8cf0c75f50a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] No waiting events found dispatching network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:24 user nova-compute[72992]: WARNING nova.compute.manager [req-2e266c66-dbc3-45f4-a5ce-ed0c3312d344 req-61bd88b3-9655-4ecf-83a5-f8cf0c75f50a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received unexpected event network-vif-plugged-25d7d1e7-b900-43a8-b497-cddd93d7b252 for instance with vm_state deleted and task_state None.
Aug 15 21:26:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-2e266c66-dbc3-45f4-a5ce-ed0c3312d344 req-61bd88b3-9655-4ecf-83a5-f8cf0c75f50a service nova] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Received event network-vif-deleted-25d7d1e7-b900-43a8-b497-cddd93d7b252 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:26:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:24 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Deleted allocations for instance 5318a1d1-16c0-4b24-b48d-b557c6f061c8
Aug 15 21:26:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-64c2985b-e1ed-4727-bca7-a542cb0b8e92 tempest-AttachVolumeTestJSON-2136218087 tempest-AttachVolumeTestJSON-2136218087-project-member] Lock "5318a1d1-16c0-4b24-b48d-b557c6f061c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.888s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-changed-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Refreshing instance network info cache due to event network-changed-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] Acquiring lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] Acquired lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Refreshing network info cache for port 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:30 user nova-compute[72992]: INFO nova.compute.manager [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Terminating instance
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-a6223f1e-7b18-4de5-b8b7-481d0664f3b6 req-933edb17-a615-4c6e-9d90-4d8dc5155016 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-unplugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a6223f1e-7b18-4de5-b8b7-481d0664f3b6 req-933edb17-a615-4c6e-9d90-4d8dc5155016 service nova] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a6223f1e-7b18-4de5-b8b7-481d0664f3b6 req-933edb17-a615-4c6e-9d90-4d8dc5155016 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a6223f1e-7b18-4de5-b8b7-481d0664f3b6 req-933edb17-a615-4c6e-9d90-4d8dc5155016 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-a6223f1e-7b18-4de5-b8b7-481d0664f3b6 req-933edb17-a615-4c6e-9d90-4d8dc5155016 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] No waiting events found dispatching network-vif-unplugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.compute.manager [req-a6223f1e-7b18-4de5-b8b7-481d0664f3b6 req-933edb17-a615-4c6e-9d90-4d8dc5155016 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-unplugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updated VIF entry in instance network info cache for port 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating instance_info_cache with network_info: [{"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-75d12ceb-794d-498e-8081-a05ff0589714 req-9587682c-64e7-41bc-9f43-ee0475601b3b service nova] Releasing lock "refresh_cache-5023ba98-b30a-4362-a183-7366a52d0feb" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Instance destroyed successfully.
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.objects.instance [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lazy-loading 'resources' on Instance uuid 5023ba98-b30a-4362-a183-7366a52d0feb {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1175731668',display_name='tempest-TestStampPattern-server-1175731668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1175731668',id=18,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZ9LQPzLnABcv71N9nYVWL+Fn/RdNmnzmuhnw6hO4OzBLkxgpbGKUob3hEumkbgp7aK0Sa2W4LWJ91yJuRehLK1Oo45fCKFQi/ADJDWYyb1i99bkbDTJmf0wrBW4+wheg==',key_name='tempest-TestStampPattern-46122809',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:19:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3407b4e631e745479767ab32173a57f9',ramdisk_id='',reservation_id='r-z2hvr0gg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2084179488',owner_user_name='tempest-TestStampPattern-2084179488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:22:26Z,user_data=None,user_id='f9781f9aa2f141d8a96849d4c90dd553',uuid=5023ba98-b30a-4362-a183-7366a52d0feb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converting VIF {"id": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "address": "fa:16:3e:18:71:88", "network": {"id": "c13aeb5b-d792-48ee-a803-9f451deb83ec", "bridge": "br-int", "label": "tempest-TestStampPattern-1475763179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3407b4e631e745479767ab32173a57f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f5b46c-b3", "ovs_interfaceid": "66f5b46c-b3ce-4fd4-9c52-f531912e7cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:71:88,bridge_name='br-int',has_traffic_filtering=True,id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f5b46c-b3') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG os_vif [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:71:88,bridge_name='br-int',has_traffic_filtering=True,id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f5b46c-b3') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66f5b46c-b3, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:26:30 user nova-compute[72992]: INFO os_vif [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:71:88,bridge_name='br-int',has_traffic_filtering=True,id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2,network=Network(c13aeb5b-d792-48ee-a803-9f451deb83ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f5b46c-b3')
Aug 15 21:26:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Deleting instance files /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb_del
Aug 15 21:26:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Deletion of /opt/stack/data/nova/instances/5023ba98-b30a-4362-a183-7366a52d0feb_del complete
Aug 15 21:26:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:31 user nova-compute[72992]: INFO nova.compute.manager [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 21:26:31 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:31 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Took 0.51 seconds to deallocate network for instance.
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-68af8777-afe8-4d45-8b21-4001e9b085fb req-9afeb430-8a63-4775-ac20-84ffa07b5904 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-deleted-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:31 user nova-compute[72992]: INFO nova.compute.manager [req-68af8777-afe8-4d45-8b21-4001e9b085fb req-9afeb430-8a63-4775-ac20-84ffa07b5904 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Neutron deleted interface 66f5b46c-b3ce-4fd4-9c52-f531912e7cc2; detaching it from the instance and deleting it from the info cache
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-68af8777-afe8-4d45-8b21-4001e9b085fb req-9afeb430-8a63-4775-ac20-84ffa07b5904 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-68af8777-afe8-4d45-8b21-4001e9b085fb req-9afeb430-8a63-4775-ac20-84ffa07b5904 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Detach interface failed, port_id=66f5b46c-b3ce-4fd4-9c52-f531912e7cc2, reason: Instance 5023ba98-b30a-4362-a183-7366a52d0feb could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:26:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:32 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Deleted allocations for instance 5023ba98-b30a-4362-a183-7366a52d0feb
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-42cc1898-f46e-42a9-bc9d-717c900e4fae tempest-TestStampPattern-2084179488 tempest-TestStampPattern-2084179488-project-member] Lock "5023ba98-b30a-4362-a183-7366a52d0feb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] No waiting events found dispatching network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:32 user nova-compute[72992]: WARNING nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received unexpected event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 for instance with vm_state deleted and task_state None.
Aug 15 21:26:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] No waiting events found dispatching network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:32 user nova-compute[72992]: WARNING nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received unexpected event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 for instance with vm_state deleted and task_state None.
Aug 15 21:26:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Acquiring lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] Lock "5023ba98-b30a-4362-a183-7366a52d0feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] No waiting events found dispatching network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:32 user nova-compute[72992]: WARNING nova.compute.manager [req-951b0c00-60f3-4588-89f1-616cd55ab923 req-14009497-ddc6-4ef8-b9bb-219a2ebe3388 service nova] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Received unexpected event network-vif-plugged-66f5b46c-b3ce-4fd4-9c52-f531912e7cc2 for instance with vm_state deleted and task_state None.
Aug 15 21:26:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:37 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134782.92199, 5318a1d1-16c0-4b24-b48d-b557c6f061c8 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:26:37 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] VM Stopped (Lifecycle Event)
Aug 15 21:26:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f6dffac1-bdc9-498d-930a-a0681e44b85c None None] [instance: 5318a1d1-16c0-4b24-b48d-b557c6f061c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:26:39 user nova-compute[72992]: INFO nova.compute.manager [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Rescuing
Aug 15 21:26:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:26:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:26:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updating instance_info_cache with network_info: [{"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-b34b0f66-b978-4ba5-8376-af4cc1c077cc req-9cfe7d51-2d2b-4224-9bad-624fa115ad10 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b34b0f66-b978-4ba5-8376-af4cc1c077cc req-9cfe7d51-2d2b-4224-9bad-624fa115ad10 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b34b0f66-b978-4ba5-8376-af4cc1c077cc req-9cfe7d51-2d2b-4224-9bad-624fa115ad10 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b34b0f66-b978-4ba5-8376-af4cc1c077cc req-9cfe7d51-2d2b-4224-9bad-624fa115ad10 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-b34b0f66-b978-4ba5-8376-af4cc1c077cc req-9cfe7d51-2d2b-4224-9bad-624fa115ad10 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:40 user nova-compute[72992]: WARNING nova.compute.manager [req-b34b0f66-b978-4ba5-8376-af4cc1c077cc req-9cfe7d51-2d2b-4224-9bad-624fa115ad10 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance destroyed successfully.
Aug 15 21:26:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Attempting a stable device rescue
Aug 15 21:26:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72992) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:26:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Creating image(s)
Aug 15 21:26:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "/opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "/opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'trusted_certs' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "11a9f951d8b49d954882a1b95cbd9e7493bb1cfc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "11a9f951d8b49d954882a1b95cbd9e7493bb1cfc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.part --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.virt.images [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] d605f290-a3c5-4bb4-afa5-5176a904be6c was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.part /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:42 user nova-compute[72992]: WARNING nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:42 user nova-compute[72992]: WARNING nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:42 user nova-compute[72992]: WARNING nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:42 user nova-compute[72992]: WARNING nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:42 user nova-compute[72992]: WARNING nova.compute.manager [req-873e1ecd-7dd1-42a1-873a-9c42e4e45530 req-cdfdd643-3e57-41eb-aa94-0ec36b4332b3 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.part /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.converted" returned: 0 in 0.567s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "11a9f951d8b49d954882a1b95cbd9e7493bb1cfc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.014s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "11a9f951d8b49d954882a1b95cbd9e7493bb1cfc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "11a9f951d8b49d954882a1b95cbd9e7493bb1cfc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc,backing_fmt=raw /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc,backing_fmt=raw /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue" returned: 0 in 0.051s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "11a9f951d8b49d954882a1b95cbd9e7493bb1cfc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'migration_context' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Start _get_guest_xml network_info=[{"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "vif_mac": "fa:16:3e:73:f8:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd605f290-a3c5-4bb4-afa5-5176a904be6c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'injEeoyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9', 'attached_at': '', 'detached_at': '', 'volume_id': '9da17aa4-252a-4007-80b3-fcc03437952a', 'serial': '9da17aa4-252a-4007-80b3-fcc03437952a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '0c46b755-9eed-4558-ac4e-b616fdef48b6', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'resources' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'numa_topology' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:43 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:26:43 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'vcpu_model' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'injEeoyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:43 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:43 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:26:43 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0e4072-9e71-4ab7-9eb4-e6cd8caa804c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = injEeoyF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 21:26:43 user nova-compute[72992]: node.name = iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a
Aug 15 21:26:43 user nova-compute[72992]: node.tpgt = -1
Aug 15 21:26:43 user nova-compute[72992]: node.startup = automatic
Aug 15 21:26:43 user nova-compute[72992]: node.leading_login = No
Aug 15 21:26:43 user nova-compute[72992]: iface.iscsi_ifacename = default
Aug 15 21:26:43 user nova-compute[72992]: iface.net_ifacename = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.ipaddress = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.prefix_len = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.hwaddress = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.transport_name = tcp
Aug 15 21:26:43 user nova-compute[72992]: iface.initiatorname = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.state = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.vlan_id = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.vlan_priority = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.vlan_state = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.iface_num = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.mtu = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.port = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.bootproto = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.subnet_mask = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.gateway = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_alt_client_id = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_dns = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_learn_iqn = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_vendor_id_state = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_vendor_id = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.dhcp_slp_da = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.fragmentation = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.gratuitous_arp = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.incoming_forwarding = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.tos_state = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.tos = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.ttl = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.delayed_ack = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.tcp_nagle = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.tcp_wsf_state = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.tcp_wsf = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.tcp_timer_scale = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.tcp_timestamp = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.redirect = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.def_task_mgmt_timeout = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.header_digest = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.data_digest = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.immediate_data = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.initial_r2t = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.data_seq_inorder = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.data_pdu_inorder = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.erl = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.max_receive_data_len = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.first_burst_len = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.max_outstanding_r2t = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.max_burst_len = 0
Aug 15 21:26:43 user nova-compute[72992]: iface.chap_auth = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.bidi_chap = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.strict_login_compliance = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.discovery_auth = <empty>
Aug 15 21:26:43 user nova-compute[72992]: iface.discovery_logout = <empty>
Aug 15 21:26:43 user nova-compute[72992]: node.discovery_address = <empty>
Aug 15 21:26:43 user nova-compute[72992]: node.discovery_port = 0
Aug 15 21:26:43 user nova-compute[72992]: node.discovery_type = static
Aug 15 21:26:43 user nova-compute[72992]: node.session.initial_cmdsn = 0
Aug 15 21:26:43 user nova-compute[72992]: node.session.initial_login_retry_max = 8
Aug 15 21:26:43 user nova-compute[72992]: node.session.xmit_thread_priority = -20
Aug 15 21:26:43 user nova-compute[72992]: node.session.cmds_max = 128
Aug 15 21:26:43 user nova-compute[72992]: node.session.queue_depth = 32
Aug 15 21:26:43 user nova-compute[72992]: node.session.nr_sessions = 1
Aug 15 21:26:43 user nova-compute[72992]: node.session.auth.authmethod = CHAP
Aug 15 21:26:43 user nova-compute[72992]: node.session.auth.username = injEeoyF
Aug 15 21:26:43 user nova-compute[72992]: node.session.auth.password = ***
Aug 15 21:26:43 user nova-compute[72992]: node.session.auth.username_in = <empty>
Aug 15 21:26:43 user nova-compute[72992]: node.session.auth.password_in = <empty>
Aug 15 21:26:43 user nova-compute[72992]: node.session.auth.chap_algs = MD5
Aug 15 21:26:43 user nova-compute[72992]: node.session.timeo.replacement_timeout = 120
Aug 15 21:26:43 user nova-compute[72992]: node.session.err_timeo.abort_timeout = 15
Aug 15 21:26:43 user nova-compute[72992]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 21:26:43 user nova-compute[72992]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 21:26:43 user nova-compute[72992]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.FastAbort = Yes
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.InitialR2T = No
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.ImmediateData = Yes
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.MaxConnections = 1
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 21:26:43 user nova-compute[72992]: node.session.iscsi.ERL = 0
Aug 15 21:26:43 user nova-compute[72992]: node.session.scan = manual
Aug 15 21:26:43 user nova-compute[72992]: node.session.reopen_max = 0
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].address = 172.16.0.220
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].port = 3260
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].startup = manual
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].tcp.window_size = 524288
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].tcp.type_of_service = 0
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].timeo.logout_timeout = 15
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].timeo.login_timeout = 15
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].timeo.auth_timeout = 45
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].iscsi.DataDigest = None
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].iscsi.IFMarker = No
Aug 15 21:26:43 user nova-compute[72992]: node.conn[0].iscsi.OFMarker = No
Aug 15 21:26:43 user nova-compute[72992]: # END RECORD
Aug 15 21:26:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[77100420-28be-4363-9801-711c11240387]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4f6bee-27d4-4947-8af4-28a38384c712]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v injEeoyF {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v injEeoyF" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432043f-0837-4a81-9a01-ea4c63657b2b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'injEeoyF'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4574f2c5-0b12-4c4b-b0e4-9e87fc2c99bf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b786e9a0-b55c-418c-b14c-824238423c5a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:43 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:43 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:26:43 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:26:43 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:26:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] HCTL ('35', '0', '0', 0) found on session 30 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd97967-e0d8-4f55-8df4-d783b5850555]: (4, ('0 0 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Searching for a device in session 30 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'injEeoyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23938356562663334', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938356562663334', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219868108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219868108',id=31,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-ish0ghuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:25:15Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "vif_mac": "fa:16:3e:73:f8:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "vif_mac": "fa:16:3e:73:f8:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'pci_devices' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:26:43 user nova-compute[72992]:   <uuid>e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9</uuid>
Aug 15 21:26:43 user nova-compute[72992]:   <name>instance-0000001f</name>
Aug 15 21:26:43 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:26:43 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:26:43 user nova-compute[72992]:   <metadata>
Aug 15 21:26:43 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:26:43 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:26:43 user nova-compute[72992]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1219868108</nova:name>
Aug 15 21:26:43 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:26:43</nova:creationTime>
Aug 15 21:26:43 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:26:43 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:26:43 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:26:43 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:26:43 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:26:43 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:26:43 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:26:43 user nova-compute[72992]:       <nova:owner>
Aug 15 21:26:43 user nova-compute[72992]:         <nova:user uuid="96dac56448a242a7817193b06d3ac23f">tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member</nova:user>
Aug 15 21:26:43 user nova-compute[72992]:         <nova:project uuid="c0d4659b5fec441f894388f4379fb182">tempest-ServerBootFromVolumeStableRescueTest-47310148</nova:project>
Aug 15 21:26:43 user nova-compute[72992]:       </nova:owner>
Aug 15 21:26:43 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:26:43 user nova-compute[72992]:       <nova:ports>
Aug 15 21:26:43 user nova-compute[72992]:         <nova:port uuid="c4083799-faf5-41d9-9893-64913d8f1da8">
Aug 15 21:26:43 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 21:26:43 user nova-compute[72992]:         </nova:port>
Aug 15 21:26:43 user nova-compute[72992]:       </nova:ports>
Aug 15 21:26:43 user nova-compute[72992]:     </nova:instance>
Aug 15 21:26:43 user nova-compute[72992]:   </metadata>
Aug 15 21:26:43 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:26:43 user nova-compute[72992]:     <system>
Aug 15 21:26:43 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:26:43 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:26:43 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:26:43 user nova-compute[72992]:       <entry name="serial">e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9</entry>
Aug 15 21:26:43 user nova-compute[72992]:       <entry name="uuid">e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9</entry>
Aug 15 21:26:43 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:26:43 user nova-compute[72992]:     </system>
Aug 15 21:26:43 user nova-compute[72992]:   </sysinfo>
Aug 15 21:26:43 user nova-compute[72992]:   <os>
Aug 15 21:26:43 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:26:43 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:26:43 user nova-compute[72992]:   </os>
Aug 15 21:26:43 user nova-compute[72992]:   <features>
Aug 15 21:26:43 user nova-compute[72992]:     <acpi/>
Aug 15 21:26:43 user nova-compute[72992]:     <apic/>
Aug 15 21:26:43 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:26:43 user nova-compute[72992]:   </features>
Aug 15 21:26:43 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:26:43 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:26:43 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:26:43 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:26:43 user nova-compute[72992]:   </clock>
Aug 15 21:26:43 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:26:43 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:26:43 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:26:43 user nova-compute[72992]:   </cpu>
Aug 15 21:26:43 user nova-compute[72992]:   <devices>
Aug 15 21:26:43 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:26:43 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:26:43 user nova-compute[72992]:       <source dev="/dev/sdd"/>
Aug 15 21:26:43 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:26:43 user nova-compute[72992]:       <serial>9da17aa4-252a-4007-80b3-fcc03437952a</serial>
Aug 15 21:26:43 user nova-compute[72992]:     </disk>
Aug 15 21:26:43 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:26:43 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:26:43 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue"/>
Aug 15 21:26:43 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:26:43 user nova-compute[72992]:       <boot order="1"/>
Aug 15 21:26:43 user nova-compute[72992]:     </disk>
Aug 15 21:26:43 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:26:43 user nova-compute[72992]:       <mac address="fa:16:3e:73:f8:45"/>
Aug 15 21:26:43 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:26:43 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:26:43 user nova-compute[72992]:       <target dev="tapc4083799-fa"/>
Aug 15 21:26:43 user nova-compute[72992]:     </interface>
Aug 15 21:26:43 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:26:43 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/console.log" append="off"/>
Aug 15 21:26:43 user nova-compute[72992]:     </serial>
Aug 15 21:26:43 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:26:43 user nova-compute[72992]:     <video>
Aug 15 21:26:43 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:26:43 user nova-compute[72992]:     </video>
Aug 15 21:26:43 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:26:43 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:26:43 user nova-compute[72992]:     </rng>
Aug 15 21:26:43 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:26:43 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:26:43 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:26:43 user nova-compute[72992]:     </memballoon>
Aug 15 21:26:43 user nova-compute[72992]:   </devices>
Aug 15 21:26:43 user nova-compute[72992]: </domain>
Aug 15 21:26:43 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:26:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance destroyed successfully.
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:26:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] No VIF found with MAC fa:16:3e:73:f8:45, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-297c67dd-0226-4174-9792-4466b3b51b65 req-28b73869-018b-4d65-b22b-93e78ab8e963 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-297c67dd-0226-4174-9792-4466b3b51b65 req-28b73869-018b-4d65-b22b-93e78ab8e963 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-297c67dd-0226-4174-9792-4466b3b51b65 req-28b73869-018b-4d65-b22b-93e78ab8e963 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-297c67dd-0226-4174-9792-4466b3b51b65 req-28b73869-018b-4d65-b22b-93e78ab8e963 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-297c67dd-0226-4174-9792-4466b3b51b65 req-28b73869-018b-4d65-b22b-93e78ab8e963 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:45 user nova-compute[72992]: WARNING nova.compute.manager [req-297c67dd-0226-4174-9792-4466b3b51b65 req-28b73869-018b-4d65-b22b-93e78ab8e963 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134790.9271061, 5023ba98-b30a-4362-a183-7366a52d0feb => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:26:45 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] VM Stopped (Lifecycle Event)
Aug 15 21:26:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f184a9b6-4b4e-4b7e-97ad-0519839b91f2 None None] [instance: 5023ba98-b30a-4362-a183-7366a52d0feb] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:26:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134807.4123228, e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:26:47 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] VM Resumed (Lifecycle Event)
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1170870a-9ce9-4c5a-b0c7-61d27d9bede8 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-19d40e2b-5ac3-4b4b-a4b0-ec05334b8f1f req-17e25806-4a20-4dc2-887b-85c21fb89450 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-19d40e2b-5ac3-4b4b-a4b0-ec05334b8f1f req-17e25806-4a20-4dc2-887b-85c21fb89450 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-19d40e2b-5ac3-4b4b-a4b0-ec05334b8f1f req-17e25806-4a20-4dc2-887b-85c21fb89450 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-19d40e2b-5ac3-4b4b-a4b0-ec05334b8f1f req-17e25806-4a20-4dc2-887b-85c21fb89450 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-19d40e2b-5ac3-4b4b-a4b0-ec05334b8f1f req-17e25806-4a20-4dc2-887b-85c21fb89450 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:26:47 user nova-compute[72992]: WARNING nova.compute.manager [req-19d40e2b-5ac3-4b4b-a4b0-ec05334b8f1f req-17e25806-4a20-4dc2-887b-85c21fb89450 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state rescuing.
Aug 15 21:26:47 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134807.416925, e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:26:47 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] VM Started (Lifecycle Event)
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:26:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:26:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-changed-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:26:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Refreshing instance network info cache due to event network-changed-4fa2e308-85c4-436b-b95f-1a795bf5d172. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:26:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] Acquiring lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:26:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] Acquired lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:26:55 user nova-compute[72992]: DEBUG nova.network.neutron [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Refreshing network info cache for port 4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:26:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updated VIF entry in instance network info cache for port 4fa2e308-85c4-436b-b95f-1a795bf5d172. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updating instance_info_cache with network_info: [{"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'flavor' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6beae7a6-55c2-48d0-9ce4-96fa9b8ba50b req-c1b7c2a2-b76a-4092-8fbd-2a6aa0f6dada service nova] Releasing lock "refresh_cache-aa27d011-e6f9-4a7c-9d06-6633aa933094" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:26:56 user nova-compute[72992]: INFO nova.compute.manager [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Attaching volume fa6d5f18-59ce-4e9f-9572-59fc33e205ae to /dev/vdb
Aug 15 21:26:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f9d992-e6f0-4025-acc1-f8682c5b4f6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2536c50-cc00-467d-9f03-399ca0183903]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa0ded-4e96-4fc7-9407-111cd8e2d3e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0695dd5d-0a4d-46b3-bf11-393d42938703]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:26:56 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:26:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9aa04-368d-43b0-ba3a-c64f37dea2db]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:26:56 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updating existing volume attachment record: c6074020-0177-43f2-8e7a-8d3b9d9f3a9c {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:26:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:01 user nova-compute[72992]: INFO nova.compute.manager [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Terminating instance
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-8e12e3f9-0377-424d-9d58-418704a9cb90 req-47e12722-8445-460e-b925-0be9bd394832 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-vif-unplugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8e12e3f9-0377-424d-9d58-418704a9cb90 req-47e12722-8445-460e-b925-0be9bd394832 service nova] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8e12e3f9-0377-424d-9d58-418704a9cb90 req-47e12722-8445-460e-b925-0be9bd394832 service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8e12e3f9-0377-424d-9d58-418704a9cb90 req-47e12722-8445-460e-b925-0be9bd394832 service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-8e12e3f9-0377-424d-9d58-418704a9cb90 req-47e12722-8445-460e-b925-0be9bd394832 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] No waiting events found dispatching network-vif-unplugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-8e12e3f9-0377-424d-9d58-418704a9cb90 req-47e12722-8445-460e-b925-0be9bd394832 service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-vif-unplugged-416afd6a-86e3-452e-b5d4-5beddccd91cb for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:27:01 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Instance destroyed successfully.
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.objects.instance [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lazy-loading 'resources' on Instance uuid 834d86c4-9546-42fc-a46a-89abefa7c77d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:24:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-482284646',display_name='tempest-AttachVolumeNegativeTest-server-482284646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-482284646',id=30,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9NPwtbW5WF3xpnUgjFfCoBF/g3oXhPNTE+iUuymdZYha5qCJXZCxrvOCF3gfABTmlazkY3WB0/ctfX41b47kvWQZJr4+iDjNq9YCQieYsVFsjHPrpmS9LlpEAsS4gYMA==',key_name='tempest-keypair-970170161',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b41e38d3f853443ea9f6352679b3240f',ramdisk_id='',reservation_id='r-mk0lv6ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1657501102',owner_user_name='tempest-AttachVolumeNegativeTest-1657501102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d12f60b35e7843838c7dcfb4487dee7d',uuid=834d86c4-9546-42fc-a46a-89abefa7c77d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converting VIF {"id": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "address": "fa:16:3e:fa:4d:5f", "network": {"id": "86616cf9-9bdf-48e6-84e9-81bbf703c26d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-91359909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b41e38d3f853443ea9f6352679b3240f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416afd6a-86", "ovs_interfaceid": "416afd6a-86e3-452e-b5d4-5beddccd91cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:4d:5f,bridge_name='br-int',has_traffic_filtering=True,id=416afd6a-86e3-452e-b5d4-5beddccd91cb,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416afd6a-86') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG os_vif [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:4d:5f,bridge_name='br-int',has_traffic_filtering=True,id=416afd6a-86e3-452e-b5d4-5beddccd91cb,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416afd6a-86') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap416afd6a-86, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:02 user nova-compute[72992]: INFO os_vif [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:4d:5f,bridge_name='br-int',has_traffic_filtering=True,id=416afd6a-86e3-452e-b5d4-5beddccd91cb,network=Network(86616cf9-9bdf-48e6-84e9-81bbf703c26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416afd6a-86')
Aug 15 21:27:02 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Deleting instance files /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d_del
Aug 15 21:27:02 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Deletion of /opt/stack/data/nova/instances/834d86c4-9546-42fc-a46a-89abefa7c77d_del complete
Aug 15 21:27:02 user nova-compute[72992]: INFO nova.compute.manager [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 15 21:27:02 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:27:02 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:27:02 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:27:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:02 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:02 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Took 0.87 seconds to deallocate network for instance.
Aug 15 21:27:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-0e0c5aa4-dd50-4dcb-a6e4-2365a608b21f req-71630204-5787-4973-96a8-46bd758d44ff service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0e0c5aa4-dd50-4dcb-a6e4-2365a608b21f req-71630204-5787-4973-96a8-46bd758d44ff service nova] Acquiring lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0e0c5aa4-dd50-4dcb-a6e4-2365a608b21f req-71630204-5787-4973-96a8-46bd758d44ff service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0e0c5aa4-dd50-4dcb-a6e4-2365a608b21f req-71630204-5787-4973-96a8-46bd758d44ff service nova] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-0e0c5aa4-dd50-4dcb-a6e4-2365a608b21f req-71630204-5787-4973-96a8-46bd758d44ff service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] No waiting events found dispatching network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:03 user nova-compute[72992]: WARNING nova.compute.manager [req-0e0c5aa4-dd50-4dcb-a6e4-2365a608b21f req-71630204-5787-4973-96a8-46bd758d44ff service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received unexpected event network-vif-plugged-416afd6a-86e3-452e-b5d4-5beddccd91cb for instance with vm_state deleted and task_state None.
Aug 15 21:27:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-0e0c5aa4-dd50-4dcb-a6e4-2365a608b21f req-71630204-5787-4973-96a8-46bd758d44ff service nova] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Received event network-vif-deleted-416afd6a-86e3-452e-b5d4-5beddccd91cb {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:03 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Deleted allocations for instance 834d86c4-9546-42fc-a46a-89abefa7c77d
Aug 15 21:27:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-44c84c35-500b-4ff1-a977-1deda6edca10 tempest-AttachVolumeNegativeTest-1657501102 tempest-AttachVolumeNegativeTest-1657501102-project-member] Lock "834d86c4-9546-42fc-a46a-89abefa7c77d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.518s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:05 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:27:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:05 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:27:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:05 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:27:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c13d9d7-d6de-45ca-ad91-34efb0e2345a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:27:05 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[efee4b8e-8d01-41c8-b212-49666b25b45c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae] added
Aug 15 21:27:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51a3414-06fe-47aa-88ee-a21d3e8fc4af]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34b8f2-2031-408e-9773-bb1cb0122868]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzdEutlm {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzdEutlm" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9627e7-e684-435e-b08f-71b3ca25bbfb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yzdEutlm'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[66822544-f0fd-42db-bd9f-303867cc24f2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94a633c-a202-4edd-8876-47cffdfc47fd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b0fc5-8557-46f8-b450-7a28afb9cc79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]
Aug 15 21:27:06 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.
Aug 15 21:27:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3150df98-4332-4875-85ef-08a453d84f28]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[94950b79-4f43-48d5-91c0-13d1d8f15eeb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:06 user nova-compute[72992]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443d818-a65d-4600-82b8-a1dbae70051d]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:27:06 user nova-compute[72992]: INFO nova.compute.claims [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Claim successful on node user
Aug 15 21:27:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:27:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:27:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:27:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Creating image(s)
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "/opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "/opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26532353634393264', 'path': '/dev/sde'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532353634393264', 'path': '/dev/sde'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.policy [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba6d0a01b4fd4a4fb70d5ed3583c1eaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b096b4da29f48e19bc3d0e432db6789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'flavor' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:27:07 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:27:07 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:27:07 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:27:07 user nova-compute[72992]:   <serial>fa6d5f18-59ce-4e9f-9572-59fc33e205ae</serial>
Aug 15 21:27:07 user nova-compute[72992]: </disk>
Aug 15 21:27:07 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk 1073741824" returned: 0 in 0.054s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No VIF found with MAC fa:16:3e:f6:1d:55, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b84a0913-4b21-4d7c-a519-aa81a24fb89e tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.759s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Successfully created port: 5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Cannot resize image /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lazy-loading 'migration_context' on Instance uuid 6e67b1bb-3b86-469e-88f4-da7c26d6ccef {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Ensure instance console log exists: /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:08 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:09 user nova-compute[72992]: INFO nova.compute.manager [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Rebuilding instance
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Successfully updated port: 5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "refresh_cache-6e67b1bb-3b86-469e-88f4-da7c26d6ccef" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquired lock "refresh_cache-6e67b1bb-3b86-469e-88f4-da7c26d6ccef" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received event network-changed-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Refreshing instance network info cache due to event network-changed-5fd0e113-1813-4231-996d-36ec3183e3d5. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] Acquiring lock "refresh_cache-6e67b1bb-3b86-469e-88f4-da7c26d6ccef" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'pci_requests' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'pci_devices' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'resources' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'migration_context' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72992) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Updating instance_info_cache with network_info: [{"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-cbb9c3f5-e7fa-43b2-9313-db8e9c158958 req-d1d98fca-b1e0-437e-8862-86ac36f24583 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-unplugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cbb9c3f5-e7fa-43b2-9313-db8e9c158958 req-d1d98fca-b1e0-437e-8862-86ac36f24583 service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cbb9c3f5-e7fa-43b2-9313-db8e9c158958 req-d1d98fca-b1e0-437e-8862-86ac36f24583 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cbb9c3f5-e7fa-43b2-9313-db8e9c158958 req-d1d98fca-b1e0-437e-8862-86ac36f24583 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-cbb9c3f5-e7fa-43b2-9313-db8e9c158958 req-d1d98fca-b1e0-437e-8862-86ac36f24583 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-unplugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:09 user nova-compute[72992]: WARNING nova.compute.manager [req-cbb9c3f5-e7fa-43b2-9313-db8e9c158958 req-d1d98fca-b1e0-437e-8862-86ac36f24583 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received unexpected event network-vif-unplugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with vm_state active and task_state rebuilding.
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Releasing lock "refresh_cache-6e67b1bb-3b86-469e-88f4-da7c26d6ccef" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Instance network_info: |[{"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] Acquired lock "refresh_cache-6e67b1bb-3b86-469e-88f4-da7c26d6ccef" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Refreshing network info cache for port 5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Start _get_guest_xml network_info=[{"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:27:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:27:09 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2036866630',display_name='tempest-VolumesNegativeTest-instance-2036866630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2036866630',id=33,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b096b4da29f48e19bc3d0e432db6789',ramdisk_id='',reservation_id='r-kbai9m8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1306736442',owner_user_name='tempest-VolumesNegativeTest-1306736442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:27:07Z,user_data=None,user_id='ba6d0a01b4fd4a4fb70d5ed3583c1eaf',uuid=6e67b1bb-3b86-469e-88f4-da7c26d6ccef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Converting VIF {"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:17:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fd0e113-1813-4231-996d-36ec3183e3d5,network=Network(d967dbdb-dde1-4c01-a311-008897143602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd0e113-18') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e67b1bb-3b86-469e-88f4-da7c26d6ccef {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:27:09 user nova-compute[72992]:   <uuid>6e67b1bb-3b86-469e-88f4-da7c26d6ccef</uuid>
Aug 15 21:27:09 user nova-compute[72992]:   <name>instance-00000021</name>
Aug 15 21:27:09 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:27:09 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:27:09 user nova-compute[72992]:   <metadata>
Aug 15 21:27:09 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:27:09 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:27:09 user nova-compute[72992]:       <nova:name>tempest-VolumesNegativeTest-instance-2036866630</nova:name>
Aug 15 21:27:09 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:27:09</nova:creationTime>
Aug 15 21:27:09 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:27:09 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:27:09 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:27:09 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:27:09 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:27:09 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:27:09 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:27:09 user nova-compute[72992]:       <nova:owner>
Aug 15 21:27:09 user nova-compute[72992]:         <nova:user uuid="ba6d0a01b4fd4a4fb70d5ed3583c1eaf">tempest-VolumesNegativeTest-1306736442-project-member</nova:user>
Aug 15 21:27:09 user nova-compute[72992]:         <nova:project uuid="8b096b4da29f48e19bc3d0e432db6789">tempest-VolumesNegativeTest-1306736442</nova:project>
Aug 15 21:27:09 user nova-compute[72992]:       </nova:owner>
Aug 15 21:27:09 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:27:09 user nova-compute[72992]:       <nova:ports>
Aug 15 21:27:09 user nova-compute[72992]:         <nova:port uuid="5fd0e113-1813-4231-996d-36ec3183e3d5">
Aug 15 21:27:09 user nova-compute[72992]:           <nova:ip type="fixed" address="192.168.233.139" ipVersion="4"/>
Aug 15 21:27:09 user nova-compute[72992]:         </nova:port>
Aug 15 21:27:09 user nova-compute[72992]:       </nova:ports>
Aug 15 21:27:09 user nova-compute[72992]:     </nova:instance>
Aug 15 21:27:09 user nova-compute[72992]:   </metadata>
Aug 15 21:27:09 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:27:09 user nova-compute[72992]:     <system>
Aug 15 21:27:09 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:27:09 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:27:09 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:27:09 user nova-compute[72992]:       <entry name="serial">6e67b1bb-3b86-469e-88f4-da7c26d6ccef</entry>
Aug 15 21:27:09 user nova-compute[72992]:       <entry name="uuid">6e67b1bb-3b86-469e-88f4-da7c26d6ccef</entry>
Aug 15 21:27:09 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:27:09 user nova-compute[72992]:     </system>
Aug 15 21:27:09 user nova-compute[72992]:   </sysinfo>
Aug 15 21:27:09 user nova-compute[72992]:   <os>
Aug 15 21:27:09 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:27:09 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:27:09 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:27:09 user nova-compute[72992]:   </os>
Aug 15 21:27:09 user nova-compute[72992]:   <features>
Aug 15 21:27:09 user nova-compute[72992]:     <acpi/>
Aug 15 21:27:09 user nova-compute[72992]:     <apic/>
Aug 15 21:27:09 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:27:09 user nova-compute[72992]:   </features>
Aug 15 21:27:09 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:27:09 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:27:09 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:27:09 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:27:09 user nova-compute[72992]:   </clock>
Aug 15 21:27:09 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:27:09 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:27:09 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:27:09 user nova-compute[72992]:   </cpu>
Aug 15 21:27:09 user nova-compute[72992]:   <devices>
Aug 15 21:27:09 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:27:09 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:27:09 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk"/>
Aug 15 21:27:09 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:27:09 user nova-compute[72992]:     </disk>
Aug 15 21:27:09 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:27:09 user nova-compute[72992]:       <mac address="fa:16:3e:07:17:0d"/>
Aug 15 21:27:09 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:27:09 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:27:09 user nova-compute[72992]:       <target dev="tap5fd0e113-18"/>
Aug 15 21:27:09 user nova-compute[72992]:     </interface>
Aug 15 21:27:09 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:27:09 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/console.log" append="off"/>
Aug 15 21:27:09 user nova-compute[72992]:     </serial>
Aug 15 21:27:09 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:27:09 user nova-compute[72992]:     <video>
Aug 15 21:27:09 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:27:09 user nova-compute[72992]:     </video>
Aug 15 21:27:09 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:27:09 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:27:09 user nova-compute[72992]:     </rng>
Aug 15 21:27:09 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:27:09 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:27:09 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:27:09 user nova-compute[72992]:     </memballoon>
Aug 15 21:27:09 user nova-compute[72992]:   </devices>
Aug 15 21:27:09 user nova-compute[72992]: </domain>
Aug 15 21:27:09 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2036866630',display_name='tempest-VolumesNegativeTest-instance-2036866630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2036866630',id=33,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b096b4da29f48e19bc3d0e432db6789',ramdisk_id='',reservation_id='r-kbai9m8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1306736442',owner_user_name='tempest-VolumesNegativeTest-1306736442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:27:07Z,user_data=None,user_id='ba6d0a01b4fd4a4fb70d5ed3583c1eaf',uuid=6e67b1bb-3b86-469e-88f4-da7c26d6ccef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Converting VIF {"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:17:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fd0e113-1813-4231-996d-36ec3183e3d5,network=Network(d967dbdb-dde1-4c01-a311-008897143602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd0e113-18') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG os_vif [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:17:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fd0e113-1813-4231-996d-36ec3183e3d5,network=Network(d967dbdb-dde1-4c01-a311-008897143602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd0e113-18') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fd0e113-18, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fd0e113-18, col_values=(('external_ids', {'iface-id': '5fd0e113-1813-4231-996d-36ec3183e3d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:17:0d', 'vm-uuid': '6e67b1bb-3b86-469e-88f4-da7c26d6ccef'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:09 user nova-compute[72992]: INFO os_vif [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:17:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fd0e113-1813-4231-996d-36ec3183e3d5,network=Network(d967dbdb-dde1-4c01-a311-008897143602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd0e113-18')
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:27:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] No VIF found with MAC fa:16:3e:07:17:0d, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG nova.network.neutron [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Updated VIF entry in instance network info cache for port 5fd0e113-1813-4231-996d-36ec3183e3d5. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG nova.network.neutron [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Updating instance_info_cache with network_info: [{"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a3ffcaf-e828-4eaf-b5f4-27991d212dee req-fe56135d-96ee-41da-9036-fb0ebcc8d120 service nova] Releasing lock "refresh_cache-6e67b1bb-3b86-469e-88f4-da7c26d6ccef" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:27:10 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance destroyed successfully.
Aug 15 21:27:10 user nova-compute[72992]: INFO nova.compute.manager [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Detaching volume fa6d5f18-59ce-4e9f-9572-59fc33e205ae
Aug 15 21:27:10 user nova-compute[72992]: INFO nova.virt.block_device [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Attempting to driver detach volume fa6d5f18-59ce-4e9f-9572-59fc33e205ae from mountpoint /dev/vdb
Aug 15 21:27:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Attempting to detach device vdb from instance aa27d011-e6f9-4a7c-9d06-6633aa933094 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:27:10 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:27:10 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:27:10 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:27:10 user nova-compute[72992]:   <serial>fa6d5f18-59ce-4e9f-9572-59fc33e205ae</serial>
Aug 15 21:27:10 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:27:10 user nova-compute[72992]: </disk>
Aug 15 21:27:10 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:27:10 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully detached device vdb from instance aa27d011-e6f9-4a7c-9d06-6633aa933094 from the persistent domain config.
Aug 15 21:27:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:10 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca9a507-3d4d-4773-ae6f-390829a5c84e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a406a-8ff5-4efb-98e8-5b9efd866fe0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:10 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:10 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:10 user nova-compute[72992]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:10 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:10 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:10 user nova-compute[72992]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64f15d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'): ({'sde'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Removing single pathed devices sde {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[759572d2-27c5-4cb5-9bd7-8b55c5aad739]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[727fdbfe-9d49-4c45-b96e-9e18f61583cd]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flushing IO for device /dev/sde {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a01129-b681-418e-873c-56b51896cbe0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[61494e77-b687-4bbb-85e0-09325a8054d5]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[777b58c7-3cbd-41fc-9181-ab27cc9db565]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d7f37-0330-4ee8-aac3-2e21b2e44b30]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]
Aug 15 21:27:10 user nova-compute[72992]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.
Aug 15 21:27:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bcd934-aeb2-45be-85c7-992a42ad6f4b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== disconnect_volume: return (292ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-5c49fe8b-df66-4300-8c62-d56c86c1a536 req-3d515518-2071-467c-afb7-5f6665f762b9 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5c49fe8b-df66-4300-8c62-d56c86c1a536 req-3d515518-2071-467c-afb7-5f6665f762b9 service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5c49fe8b-df66-4300-8c62-d56c86c1a536 req-3d515518-2071-467c-afb7-5f6665f762b9 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5c49fe8b-df66-4300-8c62-d56c86c1a536 req-3d515518-2071-467c-afb7-5f6665f762b9 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-5c49fe8b-df66-4300-8c62-d56c86c1a536 req-3d515518-2071-467c-afb7-5f6665f762b9 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:11 user nova-compute[72992]: WARNING nova.compute.manager [req-5c49fe8b-df66-4300-8c62-d56c86c1a536 req-3d515518-2071-467c-afb7-5f6665f762b9 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received unexpected event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with vm_state active and task_state rebuilding.
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-685079dc-7848-40bf-9a8d-3a9f3d4f7d8e req-328fc3ff-f1f7-4210-9127-18fda1a85303 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received event network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-685079dc-7848-40bf-9a8d-3a9f3d4f7d8e req-328fc3ff-f1f7-4210-9127-18fda1a85303 service nova] Acquiring lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-685079dc-7848-40bf-9a8d-3a9f3d4f7d8e req-328fc3ff-f1f7-4210-9127-18fda1a85303 service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-685079dc-7848-40bf-9a8d-3a9f3d4f7d8e req-328fc3ff-f1f7-4210-9127-18fda1a85303 service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-685079dc-7848-40bf-9a8d-3a9f3d4f7d8e req-328fc3ff-f1f7-4210-9127-18fda1a85303 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] No waiting events found dispatching network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:11 user nova-compute[72992]: WARNING nova.compute.manager [req-685079dc-7848-40bf-9a8d-3a9f3d4f7d8e req-328fc3ff-f1f7-4210-9127-18fda1a85303 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received unexpected event network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 for instance with vm_state building and task_state spawning.
Aug 15 21:27:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance destroyed successfully.
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-163271747',display_name='tempest-ServerActionsTestOtherA-server-1865206479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-163271747',id=32,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7bXwqMZIeNK/UPVfgL9RBymsbyZftqvthPDwEQWg/QwX2g2qv9Afjk892Qem4fCOitU+U1TDUSyRlNpSysiMh7xI3FONPSgI7IEFlYLIBEMi/wIfR0wMz+VOL+ZMfgg==',key_name='tempest-keypair-2092967577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-50bw7bpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=aa27d011-e6f9-4a7c-9d06-6633aa933094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_vif [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fa2e308-85, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:27:11 user nova-compute[72992]: INFO os_vif [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85')
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:11 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f08b8-2a9d-4a9e-9617-defcee8f3d6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1452e864-6a61-4e04-a22a-58552d4c5214]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:11 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:11 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:11 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:11 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64ee4a60>, {}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Disconnecting from: [] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== disconnect_volume: return (55ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:27:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Deleting instance files /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094_del
Aug 15 21:27:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Deletion of /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094_del complete
Aug 15 21:27:12 user nova-compute[72992]: INFO nova.virt.block_device [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Booting with volume fa6d5f18-59ce-4e9f-9572-59fc33e205ae at /dev/vdb
Aug 15 21:27:12 user nova-compute[72992]: DEBUG os_brick.utils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd6ad2-1729-49dc-9629-b5a7c13562fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[865257d8-4fbe-4fcc-bb2b-f619bc41bc57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[79876850-6026-4219-b90c-64d3e3042e2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd5e310-3db9-4c64-b5d2-d8ba07140cd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:27:12 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:27:12 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c61ea1-33f8-4543-a4f3-a6698742d37d]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG os_brick.utils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updating existing volume attachment record: 2641b787-bec2-43bb-83f4-d27b5f77cfb5 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:27:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134833.6966052, 6e67b1bb-3b86-469e-88f4-da7c26d6ccef => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] VM Resumed (Lifecycle Event)
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:27:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Instance spawned successfully.
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134833.6983838, 6e67b1bb-3b86-469e-88f4-da7c26d6ccef => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] VM Started (Lifecycle Event)
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:27:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:27:13 user nova-compute[72992]: INFO nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-5c1bfc7a-8530-4fb1-9880-eccd0406f5bd req-e2594006-f5e6-4f87-b621-1fe319d9b9ae service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received event network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5c1bfc7a-8530-4fb1-9880-eccd0406f5bd req-e2594006-f5e6-4f87-b621-1fe319d9b9ae service nova] Acquiring lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5c1bfc7a-8530-4fb1-9880-eccd0406f5bd req-e2594006-f5e6-4f87-b621-1fe319d9b9ae service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5c1bfc7a-8530-4fb1-9880-eccd0406f5bd req-e2594006-f5e6-4f87-b621-1fe319d9b9ae service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-5c1bfc7a-8530-4fb1-9880-eccd0406f5bd req-e2594006-f5e6-4f87-b621-1fe319d9b9ae service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] No waiting events found dispatching network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:13 user nova-compute[72992]: WARNING nova.compute.manager [req-5c1bfc7a-8530-4fb1-9880-eccd0406f5bd req-e2594006-f5e6-4f87-b621-1fe319d9b9ae service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received unexpected event network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 for instance with vm_state building and task_state spawning.
Aug 15 21:27:13 user nova-compute[72992]: INFO nova.compute.manager [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Took 7.36 seconds to build instance.
Aug 15 21:27:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-635d4ad3-41a4-4d4f-a853-91c608b33ad6 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.465s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:27:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:15 user nova-compute[72992]: INFO nova.compute.manager [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Unshelving
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: INFO nova.virt.block_device [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Booting with volume 5da76655-c298-42f9-b7dc-98b6502c1de7 at /dev/vdc
Aug 15 21:27:16 user nova-compute[72992]: DEBUG os_brick.utils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8809acb3-de45-462b-a227-597a1b7177dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc39a76-1934-4264-9872-59a695e10ec9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1456c890-7704-48ad-a1c4-3d9507428d1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ec085e-186e-41b1-a9ca-d6bc9b2f5377]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:27:16 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1ae4cf-92df-4037-a9aa-3922823eb912]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG os_brick.utils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating existing volume attachment record: e3cf082d-cfe4-4227-99cf-efa016afd6c1 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134821.9352899, 834d86c4-9546-42fc-a46a-89abefa7c77d => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:16 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] VM Stopped (Lifecycle Event)
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-10bd93b5-e920-4141-921e-85a1fa8a1745 None None] [instance: 834d86c4-9546-42fc-a46a-89abefa7c77d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:27:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:20 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:27:20 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7608MB free_disk=25.276039123535156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bf2b214b-f493-476b-bf23-7c13ffb3de87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance aa27d011-e6f9-4a7c-9d06-6633aa933094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 6e67b1bb-3b86-469e-88f4-da7c26d6ccef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4b290dce-4696-42ab-9b7b-fa36a6812481 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:27:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:27:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 217026e1-b750-4861-8806-f0d87eaabb45 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:27:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Creating image(s)
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updating instance_info_cache with network_info: [{"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-217026e1-b750-4861-8806-f0d87eaabb45" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.235s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk 1073741824" returned: 0 in 0.074s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.259s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Cannot resize image /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Ensure instance console log exists: /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Start _get_guest_xml network_info=[{"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa27d011-e6f9-4a7c-9d06-6633aa933094', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa6d5f18-59ce-4e9f-9572-59fc33e205ae', 'serial': 'fa6d5f18-59ce-4e9f-9572-59fc33e205ae'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '2641b787-bec2-43bb-83f4-d27b5f77cfb5', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:27:24 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 21:27:24 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:24 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:24 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:24 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a63d834-6e01-4591-8fff-0917c0f57c01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:27:24 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bbf877-de26-4a5e-980e-fbb7868e2cb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae] added
Aug 15 21:27:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b088da-9b2c-405f-ad52-7c592f17ee48]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02eaccf-98d0-4cd8-ace8-77f27e251ad1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzdEutlm {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yzdEutlm" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a101f54-9f15-443a-869e-cd5ec3f677b0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yzdEutlm'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405dda5-adc6-4bcd-9068-60b307d28e7c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebc0aa-ff24-403f-a5dc-8987a937f478]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcd4ff5-b324-4391-b62e-97d583b75be0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]
Aug 15 21:27:24 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.
Aug 15 21:27:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea7b216-f038-49ac-b491-9cd3aff1ca2f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[903768ab-a769-4d79-a6d7-cd8e7c9b8092]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:24 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[40daa773-f965-4997-9381-1bab1be9514d]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134830.4196808, aa27d011-e6f9-4a7c-9d06-6633aa933094 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:25 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] VM Stopped (Lifecycle Event)
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a2b84589-ac30-444a-84b5-30cb5a5f0333 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26532353634393264', 'path': '/dev/sde'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532353634393264', 'path': '/dev/sde'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-163271747',display_name='tempest-ServerActionsTestOtherA-server-1865206479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-163271747',id=32,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7bXwqMZIeNK/UPVfgL9RBymsbyZftqvthPDwEQWg/QwX2g2qv9Afjk892Qem4fCOitU+U1TDUSyRlNpSysiMh7xI3FONPSgI7IEFlYLIBEMi/wIfR0wMz+VOL+ZMfgg==',key_name='tempest-keypair-2092967577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-50bw7bpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=aa27d011-e6f9-4a7c-9d06-6633aa933094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:27:25 user nova-compute[72992]:   <uuid>aa27d011-e6f9-4a7c-9d06-6633aa933094</uuid>
Aug 15 21:27:25 user nova-compute[72992]:   <name>instance-00000020</name>
Aug 15 21:27:25 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:27:25 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:27:25 user nova-compute[72992]:   <metadata>
Aug 15 21:27:25 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:27:25 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:27:25 user nova-compute[72992]:       <nova:name>tempest-ServerActionsTestOtherA-server-1865206479</nova:name>
Aug 15 21:27:25 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:27:24</nova:creationTime>
Aug 15 21:27:25 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:27:25 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:27:25 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:27:25 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:27:25 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:27:25 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:27:25 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:27:25 user nova-compute[72992]:       <nova:owner>
Aug 15 21:27:25 user nova-compute[72992]:         <nova:user uuid="9192e3fb208c401190105a465161ad70">tempest-ServerActionsTestOtherA-752735396-project-member</nova:user>
Aug 15 21:27:25 user nova-compute[72992]:         <nova:project uuid="386bc7deac3d4d57ae29c8461335ca0e">tempest-ServerActionsTestOtherA-752735396</nova:project>
Aug 15 21:27:25 user nova-compute[72992]:       </nova:owner>
Aug 15 21:27:25 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:27:25 user nova-compute[72992]:       <nova:ports>
Aug 15 21:27:25 user nova-compute[72992]:         <nova:port uuid="4fa2e308-85c4-436b-b95f-1a795bf5d172">
Aug 15 21:27:25 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 21:27:25 user nova-compute[72992]:         </nova:port>
Aug 15 21:27:25 user nova-compute[72992]:       </nova:ports>
Aug 15 21:27:25 user nova-compute[72992]:     </nova:instance>
Aug 15 21:27:25 user nova-compute[72992]:   </metadata>
Aug 15 21:27:25 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:27:25 user nova-compute[72992]:     <system>
Aug 15 21:27:25 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:27:25 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:27:25 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:27:25 user nova-compute[72992]:       <entry name="serial">aa27d011-e6f9-4a7c-9d06-6633aa933094</entry>
Aug 15 21:27:25 user nova-compute[72992]:       <entry name="uuid">aa27d011-e6f9-4a7c-9d06-6633aa933094</entry>
Aug 15 21:27:25 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:27:25 user nova-compute[72992]:     </system>
Aug 15 21:27:25 user nova-compute[72992]:   </sysinfo>
Aug 15 21:27:25 user nova-compute[72992]:   <os>
Aug 15 21:27:25 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:27:25 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:27:25 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:27:25 user nova-compute[72992]:   </os>
Aug 15 21:27:25 user nova-compute[72992]:   <features>
Aug 15 21:27:25 user nova-compute[72992]:     <acpi/>
Aug 15 21:27:25 user nova-compute[72992]:     <apic/>
Aug 15 21:27:25 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:27:25 user nova-compute[72992]:   </features>
Aug 15 21:27:25 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:27:25 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:27:25 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:27:25 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:27:25 user nova-compute[72992]:   </clock>
Aug 15 21:27:25 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:27:25 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:27:25 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:27:25 user nova-compute[72992]:   </cpu>
Aug 15 21:27:25 user nova-compute[72992]:   <devices>
Aug 15 21:27:25 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:27:25 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:27:25 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk"/>
Aug 15 21:27:25 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:27:25 user nova-compute[72992]:     </disk>
Aug 15 21:27:25 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:27:25 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:27:25 user nova-compute[72992]:       <source dev="/dev/sde"/>
Aug 15 21:27:25 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:27:25 user nova-compute[72992]:       <serial>fa6d5f18-59ce-4e9f-9572-59fc33e205ae</serial>
Aug 15 21:27:25 user nova-compute[72992]:     </disk>
Aug 15 21:27:25 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:27:25 user nova-compute[72992]:       <mac address="fa:16:3e:f6:1d:55"/>
Aug 15 21:27:25 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:27:25 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:27:25 user nova-compute[72992]:       <target dev="tap4fa2e308-85"/>
Aug 15 21:27:25 user nova-compute[72992]:     </interface>
Aug 15 21:27:25 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:27:25 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/console.log" append="off"/>
Aug 15 21:27:25 user nova-compute[72992]:     </serial>
Aug 15 21:27:25 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:27:25 user nova-compute[72992]:     <video>
Aug 15 21:27:25 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:27:25 user nova-compute[72992]:     </video>
Aug 15 21:27:25 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:27:25 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:27:25 user nova-compute[72992]:     </rng>
Aug 15 21:27:25 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:27:25 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:27:25 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:27:25 user nova-compute[72992]:     </memballoon>
Aug 15 21:27:25 user nova-compute[72992]:   </devices>
Aug 15 21:27:25 user nova-compute[72992]: </domain>
Aug 15 21:27:25 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-163271747',display_name='tempest-ServerActionsTestOtherA-server-1865206479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-163271747',id=32,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7bXwqMZIeNK/UPVfgL9RBymsbyZftqvthPDwEQWg/QwX2g2qv9Afjk892Qem4fCOitU+U1TDUSyRlNpSysiMh7xI3FONPSgI7IEFlYLIBEMi/wIfR0wMz+VOL+ZMfgg==',key_name='tempest-keypair-2092967577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-50bw7bpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=aa27d011-e6f9-4a7c-9d06-6633aa933094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG os_vif [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fa2e308-85, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fa2e308-85, col_values=(('external_ids', {'iface-id': '4fa2e308-85c4-436b-b95f-1a795bf5d172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:1d:55', 'vm-uuid': 'aa27d011-e6f9-4a7c-9d06-6633aa933094'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:25 user nova-compute[72992]: INFO os_vif [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85')
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:27:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No VIF found with MAC fa:16:3e:f6:1d:55, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-9904af78-e5dd-406a-9d6b-3075894c2553 req-3ccb2ff6-dc22-49cf-8edd-90d5d47fac4f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9904af78-e5dd-406a-9d6b-3075894c2553 req-3ccb2ff6-dc22-49cf-8edd-90d5d47fac4f service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9904af78-e5dd-406a-9d6b-3075894c2553 req-3ccb2ff6-dc22-49cf-8edd-90d5d47fac4f service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9904af78-e5dd-406a-9d6b-3075894c2553 req-3ccb2ff6-dc22-49cf-8edd-90d5d47fac4f service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-9904af78-e5dd-406a-9d6b-3075894c2553 req-3ccb2ff6-dc22-49cf-8edd-90d5d47fac4f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:27 user nova-compute[72992]: WARNING nova.compute.manager [req-9904af78-e5dd-406a-9d6b-3075894c2553 req-3ccb2ff6-dc22-49cf-8edd-90d5d47fac4f service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received unexpected event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 21:27:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:27 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:27:27 user nova-compute[72992]: INFO nova.compute.claims [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Claim successful on node user
Aug 15 21:27:28 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:27:28 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:27:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:28 user nova-compute[72992]: INFO nova.network.neutron [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating port e4038664-f682-4738-afe1-42891cbda0c6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 21:27:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134849.5169177, aa27d011-e6f9-4a7c-9d06-6633aa933094 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] VM Resumed (Lifecycle Event)
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:27:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance spawned successfully.
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-bf963139-70bc-43f0-b448-5e2a2e4178e4 req-b5072e74-f717-425e-b757-66309ebc64d2 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bf963139-70bc-43f0-b448-5e2a2e4178e4 req-b5072e74-f717-425e-b757-66309ebc64d2 service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bf963139-70bc-43f0-b448-5e2a2e4178e4 req-b5072e74-f717-425e-b757-66309ebc64d2 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bf963139-70bc-43f0-b448-5e2a2e4178e4 req-b5072e74-f717-425e-b757-66309ebc64d2 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-bf963139-70bc-43f0-b448-5e2a2e4178e4 req-b5072e74-f717-425e-b757-66309ebc64d2 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:29 user nova-compute[72992]: WARNING nova.compute.manager [req-bf963139-70bc-43f0-b448-5e2a2e4178e4 req-b5072e74-f717-425e-b757-66309ebc64d2 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received unexpected event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 21:27:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134849.5184593, aa27d011-e6f9-4a7c-9d06-6633aa933094 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] VM Started (Lifecycle Event)
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:27:29 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72992) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquired lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b444c997-1cfa-4b8e-8871-71b761ace20d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-changed-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Refreshing instance network info cache due to event network-changed-e4038664-f682-4738-afe1-42891cbda0c6. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:27:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] Acquiring lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG nova.network.neutron [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating instance_info_cache with network_info: [{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Releasing lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:27:30 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Creating image(s)
Aug 15 21:27:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] Acquired lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Refreshing network info cache for port e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "6e58d08902cfed8967ebb87d1b92cd9610ccbd79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "6e58d08902cfed8967ebb87d1b92cd9610ccbd79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.part --force-share --output=json" returned: 0 in 0.227s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG nova.virt.images [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] a77f5747-1d50-4ea9-9fe2-fe89d31a3df7 was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.part /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updated VIF entry in instance network info cache for port e4038664-f682-4738-afe1-42891cbda0c6. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG nova.network.neutron [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating instance_info_cache with network_info: [{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360787bc-e6e5-401e-ab56-6d8b5e83fe41 req-49032873-d4d8-415e-af30-03b2abb9a524 service nova] Releasing lock "refresh_cache-4b290dce-4696-42ab-9b7b-fa36a6812481" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.part /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.converted" returned: 0 in 0.501s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "6e58d08902cfed8967ebb87d1b92cd9610ccbd79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.959s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79 --force-share --output=json" returned: 0 in 0.217s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "6e58d08902cfed8967ebb87d1b92cd9610ccbd79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "6e58d08902cfed8967ebb87d1b92cd9610ccbd79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79 --force-share --output=json" returned: 0 in 0.216s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79,backing_fmt=raw /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79,backing_fmt=raw /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk 1073741824" returned: 0 in 0.056s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "6e58d08902cfed8967ebb87d1b92cd9610ccbd79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79 --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:32 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'migration_context' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Rebasing disk image.
Aug 15 21:27:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.211s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d -F raw /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d -F raw /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk" returned: 0 in 2.352s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Ensure instance console log exists: /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Start _get_guest_xml network_info=[{"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b2e75a764d08fedabf9a5b5a6d8e07c8',container_format='bare',created_at=2023-08-15T21:25:23Z,direct_url=<?>,disk_format='qcow2',id=a77f5747-1d50-4ea9-9fe2-fe89d31a3df7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1819635464-shelved',owner='9937b37364574383bb2bee6622aa04c2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T21:25:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzEqGCFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4b290dce-4696-42ab-9b7b-fa36a6812481', 'attached_at': '', 'detached_at': '', 'volume_id': '5da76655-c298-42f9-b7dc-98b6502c1de7', 'serial': '5da76655-c298-42f9-b7dc-98b6502c1de7'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'e3cf082d-cfe4-4227-99cf-efa016afd6c1', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:27:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:27:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b2e75a764d08fedabf9a5b5a6d8e07c8',container_format='bare',created_at=2023-08-15T21:25:23Z,direct_url=<?>,disk_format='qcow2',id=a77f5747-1d50-4ea9-9fe2-fe89d31a3df7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1819635464-shelved',owner='9937b37364574383bb2bee6622aa04c2',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T21:25:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzEqGCFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:35 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682b1ee-2b6d-456a-a9b8-c9f2776c3e5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:27:35 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7624ebc-311a-4ae7-8418-5544ea412c6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7] added
Aug 15 21:27:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5a07b7-d7b5-49c0-8a82-955043022013]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ea17b-fccf-4f48-9946-5e4681cd14ca]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lzEqGCFK {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lzEqGCFK" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[852812dc-ba63-4c59-bb74-abc5e435f333]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lzEqGCFK'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa0d55c-9e89-4102-b9d9-fd0966fe5124]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fdd1f0-1306-4987-9a9c-cf5e272f540c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:35 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:35 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:35 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:35 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:35 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:35 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ea5a80-568a-46f9-87d3-00e57f7d0933]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260]
Aug 15 21:27:35 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260] successful.
Aug 15 21:27:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c139a103-1d4b-4025-b0b1-db91dd28a745]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[df104327-6bcb-43ad-b77a-ad4a93c188d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)
Aug 15 21:27:36 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:36 user nova-compute[72992]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)
Aug 15 21:27:36 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6acc37-045f-4281-b456-4dce831826eb]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzEqGCFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23464336566346362', 'path': '/dev/sdf'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464336566346362', 'path': '/dev/sdf'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819635464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819635464',id=27,image_ref='a77f5747-1d50-4ea9-9fe2-fe89d31a3df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-903603687',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-4tuo9m5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member',shelved_at='2023-08-15T21:25:27.866729',shelved_host='user',shelved_image_id='a77f5747-1d50-4ea9-9fe2-fe89d31a3df7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=4b290dce-4696-42ab-9b7b-fa36a6812481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:27:37 user nova-compute[72992]:   <uuid>4b290dce-4696-42ab-9b7b-fa36a6812481</uuid>
Aug 15 21:27:37 user nova-compute[72992]:   <name>instance-0000001b</name>
Aug 15 21:27:37 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:27:37 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:27:37 user nova-compute[72992]:   <metadata>
Aug 15 21:27:37 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:27:37 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:27:37 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1819635464</nova:name>
Aug 15 21:27:37 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:27:35</nova:creationTime>
Aug 15 21:27:37 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:27:37 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:27:37 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:27:37 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:27:37 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:27:37 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:27:37 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:27:37 user nova-compute[72992]:       <nova:owner>
Aug 15 21:27:37 user nova-compute[72992]:         <nova:user uuid="426fd37dacd64b46b9f8e5d93f052265">tempest-AttachVolumeShelveTestJSON-1272311701-project-member</nova:user>
Aug 15 21:27:37 user nova-compute[72992]:         <nova:project uuid="9937b37364574383bb2bee6622aa04c2">tempest-AttachVolumeShelveTestJSON-1272311701</nova:project>
Aug 15 21:27:37 user nova-compute[72992]:       </nova:owner>
Aug 15 21:27:37 user nova-compute[72992]:       <nova:root type="image" uuid="a77f5747-1d50-4ea9-9fe2-fe89d31a3df7"/>
Aug 15 21:27:37 user nova-compute[72992]:       <nova:ports>
Aug 15 21:27:37 user nova-compute[72992]:         <nova:port uuid="e4038664-f682-4738-afe1-42891cbda0c6">
Aug 15 21:27:37 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:27:37 user nova-compute[72992]:         </nova:port>
Aug 15 21:27:37 user nova-compute[72992]:       </nova:ports>
Aug 15 21:27:37 user nova-compute[72992]:     </nova:instance>
Aug 15 21:27:37 user nova-compute[72992]:   </metadata>
Aug 15 21:27:37 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:27:37 user nova-compute[72992]:     <system>
Aug 15 21:27:37 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:27:37 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:27:37 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:27:37 user nova-compute[72992]:       <entry name="serial">4b290dce-4696-42ab-9b7b-fa36a6812481</entry>
Aug 15 21:27:37 user nova-compute[72992]:       <entry name="uuid">4b290dce-4696-42ab-9b7b-fa36a6812481</entry>
Aug 15 21:27:37 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:27:37 user nova-compute[72992]:     </system>
Aug 15 21:27:37 user nova-compute[72992]:   </sysinfo>
Aug 15 21:27:37 user nova-compute[72992]:   <os>
Aug 15 21:27:37 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:27:37 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:27:37 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:27:37 user nova-compute[72992]:   </os>
Aug 15 21:27:37 user nova-compute[72992]:   <features>
Aug 15 21:27:37 user nova-compute[72992]:     <acpi/>
Aug 15 21:27:37 user nova-compute[72992]:     <apic/>
Aug 15 21:27:37 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:27:37 user nova-compute[72992]:   </features>
Aug 15 21:27:37 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:27:37 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:27:37 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:27:37 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:27:37 user nova-compute[72992]:   </clock>
Aug 15 21:27:37 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:27:37 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:27:37 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:27:37 user nova-compute[72992]:   </cpu>
Aug 15 21:27:37 user nova-compute[72992]:   <devices>
Aug 15 21:27:37 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:27:37 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:27:37 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk"/>
Aug 15 21:27:37 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:27:37 user nova-compute[72992]:     </disk>
Aug 15 21:27:37 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:27:37 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:27:37 user nova-compute[72992]:       <source dev="/dev/sdf"/>
Aug 15 21:27:37 user nova-compute[72992]:       <target dev="vdc" bus="virtio"/>
Aug 15 21:27:37 user nova-compute[72992]:       <serial>5da76655-c298-42f9-b7dc-98b6502c1de7</serial>
Aug 15 21:27:37 user nova-compute[72992]:     </disk>
Aug 15 21:27:37 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:27:37 user nova-compute[72992]:       <mac address="fa:16:3e:1f:c9:72"/>
Aug 15 21:27:37 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:27:37 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:27:37 user nova-compute[72992]:       <target dev="tape4038664-f6"/>
Aug 15 21:27:37 user nova-compute[72992]:     </interface>
Aug 15 21:27:37 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:27:37 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/console.log" append="off"/>
Aug 15 21:27:37 user nova-compute[72992]:     </serial>
Aug 15 21:27:37 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:27:37 user nova-compute[72992]:     <video>
Aug 15 21:27:37 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:27:37 user nova-compute[72992]:     </video>
Aug 15 21:27:37 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:27:37 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:27:37 user nova-compute[72992]:     </rng>
Aug 15 21:27:37 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:27:37 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:27:37 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:27:37 user nova-compute[72992]:     </memballoon>
Aug 15 21:27:37 user nova-compute[72992]:   </devices>
Aug 15 21:27:37 user nova-compute[72992]: </domain>
Aug 15 21:27:37 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819635464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819635464',id=27,image_ref='a77f5747-1d50-4ea9-9fe2-fe89d31a3df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-903603687',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-4tuo9m5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member',shelved_at='2023-08-15T21:25:27.866729',shelved_host='user',shelved_image_id='a77f5747-1d50-4ea9-9fe2-fe89d31a3df7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=4b290dce-4696-42ab-9b7b-fa36a6812481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG os_vif [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4038664-f6, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4038664-f6, col_values=(('external_ids', {'iface-id': 'e4038664-f682-4738-afe1-42891cbda0c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:c9:72', 'vm-uuid': '4b290dce-4696-42ab-9b7b-fa36a6812481'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:37 user nova-compute[72992]: INFO os_vif [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6')
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No VIF found with MAC fa:16:3e:1f:c9:72, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:27:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-2c184bfb-e6ab-4449-baf9-299ebb5affb6 req-b952b9b5-fe93-45a6-a24f-d4f13f82d3c8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2c184bfb-e6ab-4449-baf9-299ebb5affb6 req-b952b9b5-fe93-45a6-a24f-d4f13f82d3c8 service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2c184bfb-e6ab-4449-baf9-299ebb5affb6 req-b952b9b5-fe93-45a6-a24f-d4f13f82d3c8 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2c184bfb-e6ab-4449-baf9-299ebb5affb6 req-b952b9b5-fe93-45a6-a24f-d4f13f82d3c8 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-2c184bfb-e6ab-4449-baf9-299ebb5affb6 req-b952b9b5-fe93-45a6-a24f-d4f13f82d3c8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:39 user nova-compute[72992]: WARNING nova.compute.manager [req-2c184bfb-e6ab-4449-baf9-299ebb5affb6 req-b952b9b5-fe93-45a6-a24f-d4f13f82d3c8 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received unexpected event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 21:27:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134860.8075604, 4b290dce-4696-42ab-9b7b-fa36a6812481 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:40 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] VM Resumed (Lifecycle Event)
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:27:40 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance spawned successfully.
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:27:40 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134860.8118856, 4b290dce-4696-42ab-9b7b-fa36a6812481 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:27:40 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] VM Started (Lifecycle Event)
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:27:40 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:27:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:27:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4b31dc77-1f6c-454c-a49e-d6afcb3906b0 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.209s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-33e8fd4f-70cf-449e-85ba-34f27d3a9f20 req-e0276f41-4e21-41c0-b3ad-b9065848a66c service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33e8fd4f-70cf-449e-85ba-34f27d3a9f20 req-e0276f41-4e21-41c0-b3ad-b9065848a66c service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33e8fd4f-70cf-449e-85ba-34f27d3a9f20 req-e0276f41-4e21-41c0-b3ad-b9065848a66c service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-33e8fd4f-70cf-449e-85ba-34f27d3a9f20 req-e0276f41-4e21-41c0-b3ad-b9065848a66c service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-33e8fd4f-70cf-449e-85ba-34f27d3a9f20 req-e0276f41-4e21-41c0-b3ad-b9065848a66c service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:27:41 user nova-compute[72992]: WARNING nova.compute.manager [req-33e8fd4f-70cf-449e-85ba-34f27d3a9f20 req-e0276f41-4e21-41c0-b3ad-b9065848a66c service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received unexpected event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with vm_state active and task_state None.
Aug 15 21:27:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing instance network info cache due to event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:27:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] Acquiring lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:27:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] Acquired lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:27:46 user nova-compute[72992]: DEBUG nova.network.neutron [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:47 user nova-compute[72992]: INFO nova.compute.manager [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Detaching volume 48d2da2a-74cc-4e7a-82a3-1317772a0c22
Aug 15 21:27:47 user nova-compute[72992]: INFO nova.virt.block_device [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Attempting to driver detach volume 48d2da2a-74cc-4e7a-82a3-1317772a0c22 from mountpoint /dev/vdb
Aug 15 21:27:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Attempting to detach device vdb from instance bf2b214b-f493-476b-bf23-7c13ffb3de87 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:27:47 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:27:47 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:27:47 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:27:47 user nova-compute[72992]:   <serial>48d2da2a-74cc-4e7a-82a3-1317772a0c22</serial>
Aug 15 21:27:47 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:27:47 user nova-compute[72992]: </disk>
Aug 15 21:27:47 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:27:47 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully detached device vdb from instance bf2b214b-f493-476b-bf23-7c13ffb3de87 from the persistent domain config.
Aug 15 21:27:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf2b214b-f493-476b-bf23-7c13ffb3de87 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:27:47 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:27:47 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:27:47 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:27:47 user nova-compute[72992]:   <serial>48d2da2a-74cc-4e7a-82a3-1317772a0c22</serial>
Aug 15 21:27:47 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:27:47 user nova-compute[72992]: </disk>
Aug 15 21:27:47 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updated VIF entry in instance network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8c60a858-807f-4c24-b3ef-0fa3a575de1e req-7b36c7c2-b262-42da-86d8-83efc096d765 service nova] Releasing lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134868.0995657, bf2b214b-f493-476b-bf23-7c13ffb3de87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:27:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully detached device vdb from instance bf2b214b-f493-476b-bf23-7c13ffb3de87 from the live domain config.
Aug 15 21:27:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lZakxwpO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:27:48 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38ee565-e2e0-4380-9de0-28bd206096e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04c517-83e3-4ea1-8635-403c1346a822]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)
Aug 15 21:27:48 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:27:48 user nova-compute[72992]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)
Aug 15 21:27:48 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0cb52fb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa45c6e-584e-4fdf-acaa-bcc3fb8fc62f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a9fd7c-da6c-47b2-a1d4-a4f8ae50f4a1]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a664c2-85f7-4538-8cfa-314833044ea0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a88101b-8f7d-41db-beda-3debcb86b3cf]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e412a-f200-470a-bafa-aa9c141ff5f4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0349fcb-6e36-4fd5-aea2-c000ca673571]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260]
Aug 15 21:27:48 user nova-compute[72992]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22, portal: 172.16.0.220,3260] successful.
Aug 15 21:27:48 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48d2da2a-74cc-4e7a-82a3-1317772a0c22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e380a569-f129-4a31-a3aa-e93cdea4a7a5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] <== disconnect_volume: return (326ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:27:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing instance network info cache due to event network-changed-7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] Acquiring lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] Acquired lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Refreshing network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'flavor' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8546944a-cc0f-4af1-9458-a17d40499bba tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.758s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updated VIF entry in instance network info cache for port 7eb3b13a-2761-4a8c-97cd-1f991ef988be. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [{"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:27:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1a328a99-ed77-48cb-89bd-012cdfd05905 req-5e070c20-89bb-4210-af50-01d0dfd85e3a service nova] Releasing lock "refresh_cache-bf2b214b-f493-476b-bf23-7c13ffb3de87" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:27:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:27:59 user nova-compute[72992]: INFO nova.compute.claims [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Claim successful on node user
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.network.neutron [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:27:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:27:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG nova.policy [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '780eb2549a2f45539251937d0776d0a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f68f75448b4762a0fa9dfd0a426d14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:28:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Creating image(s)
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "/opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "/opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.222s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk 1073741824" returned: 0 in 0.066s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Successfully created port: e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:28:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Cannot resize image /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.objects.instance [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'migration_context' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Ensure instance console log exists: /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Successfully updated port: e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquired lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-changed-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Refreshing instance network info cache due to event network-changed-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] Acquiring lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:28:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating instance_info_cache with network_info: [{"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Releasing lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Instance network_info: |[{"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] Acquired lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Refreshing network info cache for port e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Start _get_guest_xml network_info=[{"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:28:02 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:28:02 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-307451061',display_name='tempest-SnapshotDataIntegrityTests-server-307451061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-307451061',id=34,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2krXaJGcGX/l2RLZQHlknrM++XHOruRbnF4rSYLHIROpPtwY9pGGC1zDn1n2W8rVlDU7dVncgjEEGkvJNhF8UeYqs/c4YqBMZK2GZAOG4nILwQB7/vfIhmXw8CoZKZww==',key_name='tempest-keypair-829588425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f68f75448b4762a0fa9dfd0a426d14',ramdisk_id='',reservation_id='r-w5j0m0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1911350914',owner_user_name='tempest-SnapshotDataIntegrityTests-1911350914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780eb2549a2f45539251937d0776d0a8',uuid=d3234f5a-b582-45eb-9d1d-605b9c7c0e21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Converting VIF {"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=e39d6d79-a4a7-461c-9f11-14be5d7fd5ee,network=Network(592eb26a-e6ee-4427-b55f-17a31bd3a74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d6d79-a4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.objects.instance [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'pci_devices' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:28:02 user nova-compute[72992]:   <uuid>d3234f5a-b582-45eb-9d1d-605b9c7c0e21</uuid>
Aug 15 21:28:02 user nova-compute[72992]:   <name>instance-00000022</name>
Aug 15 21:28:02 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:28:02 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:28:02 user nova-compute[72992]:   <metadata>
Aug 15 21:28:02 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:28:02 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:28:02 user nova-compute[72992]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-307451061</nova:name>
Aug 15 21:28:02 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:28:02</nova:creationTime>
Aug 15 21:28:02 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:28:02 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:28:02 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:28:02 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:28:02 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:28:02 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:28:02 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:28:02 user nova-compute[72992]:       <nova:owner>
Aug 15 21:28:02 user nova-compute[72992]:         <nova:user uuid="780eb2549a2f45539251937d0776d0a8">tempest-SnapshotDataIntegrityTests-1911350914-project-member</nova:user>
Aug 15 21:28:02 user nova-compute[72992]:         <nova:project uuid="89f68f75448b4762a0fa9dfd0a426d14">tempest-SnapshotDataIntegrityTests-1911350914</nova:project>
Aug 15 21:28:02 user nova-compute[72992]:       </nova:owner>
Aug 15 21:28:02 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:28:02 user nova-compute[72992]:       <nova:ports>
Aug 15 21:28:02 user nova-compute[72992]:         <nova:port uuid="e39d6d79-a4a7-461c-9f11-14be5d7fd5ee">
Aug 15 21:28:02 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 21:28:02 user nova-compute[72992]:         </nova:port>
Aug 15 21:28:02 user nova-compute[72992]:       </nova:ports>
Aug 15 21:28:02 user nova-compute[72992]:     </nova:instance>
Aug 15 21:28:02 user nova-compute[72992]:   </metadata>
Aug 15 21:28:02 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:28:02 user nova-compute[72992]:     <system>
Aug 15 21:28:02 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:28:02 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:28:02 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:28:02 user nova-compute[72992]:       <entry name="serial">d3234f5a-b582-45eb-9d1d-605b9c7c0e21</entry>
Aug 15 21:28:02 user nova-compute[72992]:       <entry name="uuid">d3234f5a-b582-45eb-9d1d-605b9c7c0e21</entry>
Aug 15 21:28:02 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:28:02 user nova-compute[72992]:     </system>
Aug 15 21:28:02 user nova-compute[72992]:   </sysinfo>
Aug 15 21:28:02 user nova-compute[72992]:   <os>
Aug 15 21:28:02 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:28:02 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:28:02 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:28:02 user nova-compute[72992]:   </os>
Aug 15 21:28:02 user nova-compute[72992]:   <features>
Aug 15 21:28:02 user nova-compute[72992]:     <acpi/>
Aug 15 21:28:02 user nova-compute[72992]:     <apic/>
Aug 15 21:28:02 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:28:02 user nova-compute[72992]:   </features>
Aug 15 21:28:02 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:28:02 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:28:02 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:28:02 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:28:02 user nova-compute[72992]:   </clock>
Aug 15 21:28:02 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:28:02 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:28:02 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:28:02 user nova-compute[72992]:   </cpu>
Aug 15 21:28:02 user nova-compute[72992]:   <devices>
Aug 15 21:28:02 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:28:02 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:28:02 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk"/>
Aug 15 21:28:02 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:28:02 user nova-compute[72992]:     </disk>
Aug 15 21:28:02 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:28:02 user nova-compute[72992]:       <mac address="fa:16:3e:75:66:b5"/>
Aug 15 21:28:02 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:28:02 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:28:02 user nova-compute[72992]:       <target dev="tape39d6d79-a4"/>
Aug 15 21:28:02 user nova-compute[72992]:     </interface>
Aug 15 21:28:02 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:28:02 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/console.log" append="off"/>
Aug 15 21:28:02 user nova-compute[72992]:     </serial>
Aug 15 21:28:02 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:28:02 user nova-compute[72992]:     <video>
Aug 15 21:28:02 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:28:02 user nova-compute[72992]:     </video>
Aug 15 21:28:02 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:28:02 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:28:02 user nova-compute[72992]:     </rng>
Aug 15 21:28:02 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:28:02 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:28:02 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:28:02 user nova-compute[72992]:     </memballoon>
Aug 15 21:28:02 user nova-compute[72992]:   </devices>
Aug 15 21:28:02 user nova-compute[72992]: </domain>
Aug 15 21:28:02 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-307451061',display_name='tempest-SnapshotDataIntegrityTests-server-307451061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-307451061',id=34,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2krXaJGcGX/l2RLZQHlknrM++XHOruRbnF4rSYLHIROpPtwY9pGGC1zDn1n2W8rVlDU7dVncgjEEGkvJNhF8UeYqs/c4YqBMZK2GZAOG4nILwQB7/vfIhmXw8CoZKZww==',key_name='tempest-keypair-829588425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f68f75448b4762a0fa9dfd0a426d14',ramdisk_id='',reservation_id='r-w5j0m0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1911350914',owner_user_name='tempest-SnapshotDataIntegrityTests-1911350914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:28:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780eb2549a2f45539251937d0776d0a8',uuid=d3234f5a-b582-45eb-9d1d-605b9c7c0e21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Converting VIF {"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=e39d6d79-a4a7-461c-9f11-14be5d7fd5ee,network=Network(592eb26a-e6ee-4427-b55f-17a31bd3a74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d6d79-a4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG os_vif [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=e39d6d79-a4a7-461c-9f11-14be5d7fd5ee,network=Network(592eb26a-e6ee-4427-b55f-17a31bd3a74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d6d79-a4') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape39d6d79-a4, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape39d6d79-a4, col_values=(('external_ids', {'iface-id': 'e39d6d79-a4a7-461c-9f11-14be5d7fd5ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:66:b5', 'vm-uuid': 'd3234f5a-b582-45eb-9d1d-605b9c7c0e21'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:02 user nova-compute[72992]: INFO os_vif [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=e39d6d79-a4a7-461c-9f11-14be5d7fd5ee,network=Network(592eb26a-e6ee-4427-b55f-17a31bd3a74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d6d79-a4')
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No VIF found with MAC fa:16:3e:75:66:b5, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updated VIF entry in instance network info cache for port e39d6d79-a4a7-461c-9f11-14be5d7fd5ee. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG nova.network.neutron [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating instance_info_cache with network_info: [{"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c542523b-aebb-4d43-81f0-cfda83b99e9a req-b5c4bcbe-6f18-4ab1-9778-00e80046ae66 service nova] Releasing lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:28:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-34fa9590-f7ae-4d72-8ffb-b9816cc09d72 req-33ac6a4f-ae81-47dc-bd1b-f13b7030d42f service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-34fa9590-f7ae-4d72-8ffb-b9816cc09d72 req-33ac6a4f-ae81-47dc-bd1b-f13b7030d42f service nova] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-34fa9590-f7ae-4d72-8ffb-b9816cc09d72 req-33ac6a4f-ae81-47dc-bd1b-f13b7030d42f service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-34fa9590-f7ae-4d72-8ffb-b9816cc09d72 req-33ac6a4f-ae81-47dc-bd1b-f13b7030d42f service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-34fa9590-f7ae-4d72-8ffb-b9816cc09d72 req-33ac6a4f-ae81-47dc-bd1b-f13b7030d42f service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] No waiting events found dispatching network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:04 user nova-compute[72992]: WARNING nova.compute.manager [req-34fa9590-f7ae-4d72-8ffb-b9816cc09d72 req-33ac6a4f-ae81-47dc-bd1b-f13b7030d42f service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received unexpected event network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee for instance with vm_state building and task_state spawning.
Aug 15 21:28:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134886.1988177, d3234f5a-b582-45eb-9d1d-605b9c7c0e21 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:28:06 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] VM Resumed (Lifecycle Event)
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:28:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Instance spawned successfully.
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:28:06 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134886.2047997, d3234f5a-b582-45eb-9d1d-605b9c7c0e21 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:28:06 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] VM Started (Lifecycle Event)
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-e50338c8-dd78-4659-a110-62ead374b8e5 req-3059a332-91d6-4cd3-861d-17b4bad0bd6c service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e50338c8-dd78-4659-a110-62ead374b8e5 req-3059a332-91d6-4cd3-861d-17b4bad0bd6c service nova] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e50338c8-dd78-4659-a110-62ead374b8e5 req-3059a332-91d6-4cd3-861d-17b4bad0bd6c service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e50338c8-dd78-4659-a110-62ead374b8e5 req-3059a332-91d6-4cd3-861d-17b4bad0bd6c service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-e50338c8-dd78-4659-a110-62ead374b8e5 req-3059a332-91d6-4cd3-861d-17b4bad0bd6c service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] No waiting events found dispatching network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:06 user nova-compute[72992]: WARNING nova.compute.manager [req-e50338c8-dd78-4659-a110-62ead374b8e5 req-3059a332-91d6-4cd3-861d-17b4bad0bd6c service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received unexpected event network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee for instance with vm_state building and task_state spawning.
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:28:06 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:28:06 user nova-compute[72992]: INFO nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 15 21:28:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:28:06 user nova-compute[72992]: INFO nova.compute.manager [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Took 7.19 seconds to build instance.
Aug 15 21:28:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-47b53ad7-bc28-4c2e-b91c-184411e914dd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.304s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:09 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:16 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:28:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:28:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7102MB free_disk=25.17940902709961GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance bf2b214b-f493-476b-bf23-7c13ffb3de87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance aa27d011-e6f9-4a7c-9d06-6633aa933094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 6e67b1bb-3b86-469e-88f4-da7c26d6ccef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4b290dce-4696-42ab-9b7b-fa36a6812481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:28:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:28:23 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:28:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:28:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:28:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:28:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:28:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:28:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:28:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [{"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-a6e7c604-49e8-47af-a81f-2da89401ea96" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:28:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:28:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:28:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:28:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:30 user nova-compute[72992]: INFO nova.compute.manager [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Unrescuing
Aug 15 21:28:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:28:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquired lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:28:30 user nova-compute[72992]: DEBUG nova.network.neutron [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updating instance_info_cache with network_info: [{"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Releasing lock "refresh_cache-e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG nova.objects.instance [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'flavor' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-35a7088c-bdc0-4033-8b65-c8e31e54d0b2 req-75a9fb4e-a9a3-44c2-be33-1717916c3e01 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-35a7088c-bdc0-4033-8b65-c8e31e54d0b2 req-75a9fb4e-a9a3-44c2-be33-1717916c3e01 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-35a7088c-bdc0-4033-8b65-c8e31e54d0b2 req-75a9fb4e-a9a3-44c2-be33-1717916c3e01 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-35a7088c-bdc0-4033-8b65-c8e31e54d0b2 req-75a9fb4e-a9a3-44c2-be33-1717916c3e01 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-35a7088c-bdc0-4033-8b65-c8e31e54d0b2 req-75a9fb4e-a9a3-44c2-be33-1717916c3e01 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:31 user nova-compute[72992]: WARNING nova.compute.manager [req-35a7088c-bdc0-4033-8b65-c8e31e54d0b2 req-75a9fb4e-a9a3-44c2-be33-1717916c3e01 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:28:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:31 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance destroyed successfully.
Aug 15 21:28:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-b69ec50c-28c2-43fc-830b-1744e8a1b08a req-e40ba88c-01f0-4b33-8392-f5eda8e9f397 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b69ec50c-28c2-43fc-830b-1744e8a1b08a req-e40ba88c-01f0-4b33-8392-f5eda8e9f397 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b69ec50c-28c2-43fc-830b-1744e8a1b08a req-e40ba88c-01f0-4b33-8392-f5eda8e9f397 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b69ec50c-28c2-43fc-830b-1744e8a1b08a req-e40ba88c-01f0-4b33-8392-f5eda8e9f397 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-b69ec50c-28c2-43fc-830b-1744e8a1b08a req-e40ba88c-01f0-4b33-8392-f5eda8e9f397 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:33 user nova-compute[72992]: WARNING nova.compute.manager [req-b69ec50c-28c2-43fc-830b-1744e8a1b08a req-e40ba88c-01f0-4b33-8392-f5eda8e9f397 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state rescued and task_state unrescuing.
Aug 15 21:28:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134915.4925382, e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:28:35 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] VM Resumed (Lifecycle Event)
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-49abc4ac-630a-4000-a12c-d587e63e81b7 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:28:35 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134915.494837, e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:28:35 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] VM Started (Lifecycle Event)
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:35 user nova-compute[72992]: WARNING nova.compute.manager [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state None.
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:35 user nova-compute[72992]: WARNING nova.compute.manager [req-4920eaf1-d146-40a8-95c1-3b40d36f20e2 req-225df2b4-7891-494a-bd0f-3cf4f5754307 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state None.
Aug 15 21:28:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:37 user nova-compute[72992]: INFO nova.compute.manager [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Terminating instance
Aug 15 21:28:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-f54c9f0d-bd60-4ace-947d-4bcd9289ef5c req-0d5d1cb9-1739-4ddd-9017-77f0c8655034 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f54c9f0d-bd60-4ace-947d-4bcd9289ef5c req-0d5d1cb9-1739-4ddd-9017-77f0c8655034 service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f54c9f0d-bd60-4ace-947d-4bcd9289ef5c req-0d5d1cb9-1739-4ddd-9017-77f0c8655034 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f54c9f0d-bd60-4ace-947d-4bcd9289ef5c req-0d5d1cb9-1739-4ddd-9017-77f0c8655034 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-f54c9f0d-bd60-4ace-947d-4bcd9289ef5c req-0d5d1cb9-1739-4ddd-9017-77f0c8655034 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-f54c9f0d-bd60-4ace-947d-4bcd9289ef5c req-0d5d1cb9-1739-4ddd-9017-77f0c8655034 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-unplugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Instance destroyed successfully.
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.objects.instance [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'resources' on Instance uuid bf2b214b-f493-476b-bf23-7c13ffb3de87 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-135965252',display_name='tempest-ServerRescueNegativeTestJSON-server-135965252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-135965252',id=24,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoG7GLpTZPIOfeTNrohuB6QD35sMMlIjTG5U6PRzFh/AtDn9UGQjcGWYvJfTnSYCuFGyxwI6pFesDQzIamJCfWpCR5fIVkOuj+B9x49Vyzcj8PQs8beXHdOLu3i5X/Fnw==',key_name='tempest-keypair-218307302',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-yqqqodut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08a032f1741f46ee814186f61b82aac4',uuid=bf2b214b-f493-476b-bf23-7c13ffb3de87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "address": "fa:16:3e:50:ed:9e", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb3b13a-27", "ovs_interfaceid": "7eb3b13a-2761-4a8c-97cd-1f991ef988be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG os_vif [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eb3b13a-27, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:28:38 user nova-compute[72992]: INFO os_vif [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:ed:9e,bridge_name='br-int',has_traffic_filtering=True,id=7eb3b13a-2761-4a8c-97cd-1f991ef988be,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb3b13a-27')
Aug 15 21:28:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Deleting instance files /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87_del
Aug 15 21:28:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Deletion of /opt/stack/data/nova/instances/bf2b214b-f493-476b-bf23-7c13ffb3de87_del complete
Aug 15 21:28:38 user nova-compute[72992]: INFO nova.compute.manager [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 21:28:38 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:28:38 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-287fde68-0afb-4d9d-8af2-d255305d73eb req-a716ae8d-6e29-4f51-b3eb-01a07ee81b22 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-287fde68-0afb-4d9d-8af2-d255305d73eb req-a716ae8d-6e29-4f51-b3eb-01a07ee81b22 service nova] Acquiring lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-287fde68-0afb-4d9d-8af2-d255305d73eb req-a716ae8d-6e29-4f51-b3eb-01a07ee81b22 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-287fde68-0afb-4d9d-8af2-d255305d73eb req-a716ae8d-6e29-4f51-b3eb-01a07ee81b22 service nova] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-287fde68-0afb-4d9d-8af2-d255305d73eb req-a716ae8d-6e29-4f51-b3eb-01a07ee81b22 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] No waiting events found dispatching network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:40 user nova-compute[72992]: WARNING nova.compute.manager [req-287fde68-0afb-4d9d-8af2-d255305d73eb req-a716ae8d-6e29-4f51-b3eb-01a07ee81b22 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received unexpected event network-vif-plugged-7eb3b13a-2761-4a8c-97cd-1f991ef988be for instance with vm_state active and task_state deleting.
Aug 15 21:28:40 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Took 1.37 seconds to deallocate network for instance.
Aug 15 21:28:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG nova.compute.manager [req-d8c2a479-2ee2-4168-80ab-3c316f86cb75 req-6a17ea51-1eb3-4194-8c72-2f9298176ed9 service nova] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Received event network-vif-deleted-7eb3b13a-2761-4a8c-97cd-1f991ef988be {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:28:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:40 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Deleted allocations for instance bf2b214b-f493-476b-bf23-7c13ffb3de87
Aug 15 21:28:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2d061989-cb82-4ee1-a392-319656da3aab tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "bf2b214b-f493-476b-bf23-7c13ffb3de87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.999s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:53 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134918.772944, bf2b214b-f493-476b-bf23-7c13ffb3de87 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:28:53 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] VM Stopped (Lifecycle Event)
Aug 15 21:28:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a3ffbe8e-00af-4c15-ac9f-bc870c448bec None None] [instance: bf2b214b-f493-476b-bf23-7c13ffb3de87] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:28:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:28:55 user nova-compute[72992]: INFO nova.compute.claims [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Claim successful on node user
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:28:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.policy [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '478df679862f4c3a9887beb0fd2518c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d22c8835e4819aadcf9cbe0180dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:28:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Creating image(s)
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "/opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "/opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "48d3349cf1be8deaf9941796827a50f2755b78da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "48d3349cf1be8deaf9941796827a50f2755b78da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.part --force-share --output=json" returned: 0 in 0.225s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG nova.virt.images [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] 45b8bf5e-667b-4182-9892-7fe510ef5a6e was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.part /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Successfully created port: 377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:56 user nova-compute[72992]: INFO nova.compute.manager [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Terminating instance
Aug 15 21:28:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.part /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.converted" returned: 0 in 0.284s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "48d3349cf1be8deaf9941796827a50f2755b78da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.294s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-02dd17af-deb2-4d88-97a3-21015bc24e7a req-b9b3b001-3faa-4ff3-a7fd-10c5c366edd7 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received event network-vif-unplugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-02dd17af-deb2-4d88-97a3-21015bc24e7a req-b9b3b001-3faa-4ff3-a7fd-10c5c366edd7 service nova] Acquiring lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-02dd17af-deb2-4d88-97a3-21015bc24e7a req-b9b3b001-3faa-4ff3-a7fd-10c5c366edd7 service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-02dd17af-deb2-4d88-97a3-21015bc24e7a req-b9b3b001-3faa-4ff3-a7fd-10c5c366edd7 service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-02dd17af-deb2-4d88-97a3-21015bc24e7a req-b9b3b001-3faa-4ff3-a7fd-10c5c366edd7 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] No waiting events found dispatching network-vif-unplugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-02dd17af-deb2-4d88-97a3-21015bc24e7a req-b9b3b001-3faa-4ff3-a7fd-10c5c366edd7 service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received event network-vif-unplugged-5fd0e113-1813-4231-996d-36ec3183e3d5 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "48d3349cf1be8deaf9941796827a50f2755b78da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "48d3349cf1be8deaf9941796827a50f2755b78da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Instance destroyed successfully.
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lazy-loading 'resources' on Instance uuid 6e67b1bb-3b86-469e-88f4-da7c26d6ccef {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da,backing_fmt=raw /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:27:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2036866630',display_name='tempest-VolumesNegativeTest-instance-2036866630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2036866630',id=33,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b096b4da29f48e19bc3d0e432db6789',ramdisk_id='',reservation_id='r-kbai9m8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1306736442',owner_user_name='tempest-VolumesNegativeTest-1306736442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:27:14Z,user_data=None,user_id='ba6d0a01b4fd4a4fb70d5ed3583c1eaf',uuid=6e67b1bb-3b86-469e-88f4-da7c26d6ccef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Converting VIF {"id": "5fd0e113-1813-4231-996d-36ec3183e3d5", "address": "fa:16:3e:07:17:0d", "network": {"id": "d967dbdb-dde1-4c01-a311-008897143602", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "7104e0de04484c12bdc6cdf1f7e22630", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fd0e113-18", "ovs_interfaceid": "5fd0e113-1813-4231-996d-36ec3183e3d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:17:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fd0e113-1813-4231-996d-36ec3183e3d5,network=Network(d967dbdb-dde1-4c01-a311-008897143602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd0e113-18') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG os_vif [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:17:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fd0e113-1813-4231-996d-36ec3183e3d5,network=Network(d967dbdb-dde1-4c01-a311-008897143602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd0e113-18') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da,backing_fmt=raw /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk 1073741824" returned: 0 in 0.054s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fd0e113-18, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "48d3349cf1be8deaf9941796827a50f2755b78da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:28:57 user nova-compute[72992]: INFO os_vif [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:17:0d,bridge_name='br-int',has_traffic_filtering=True,id=5fd0e113-1813-4231-996d-36ec3183e3d5,network=Network(d967dbdb-dde1-4c01-a311-008897143602),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fd0e113-18')
Aug 15 21:28:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Deleting instance files /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef_del
Aug 15 21:28:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Deletion of /opt/stack/data/nova/instances/6e67b1bb-3b86-469e-88f4-da7c26d6ccef_del complete
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.network.neutron [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Successfully updated port: 377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquired lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.network.neutron [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing instance network info cache due to event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] Acquiring lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:28:57 user nova-compute[72992]: INFO nova.compute.manager [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json" returned: 0 in 0.269s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:28:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Cannot resize image /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'migration_context' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Ensure instance console log exists: /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Releasing lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance network_info: |[{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] Acquired lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.neutron [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Start _get_guest_xml network_info=[{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:28:52Z,direct_url=<?>,disk_format='qcow2',id=45b8bf5e-667b-4182-9892-7fe510ef5a6e,min_disk=0,min_ram=0,name='tempest-scenario-img--1072434253',owner='626d22c8835e4819aadcf9cbe0180dc1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:28:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '45b8bf5e-667b-4182-9892-7fe510ef5a6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:28:58 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:28:58 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:28:52Z,direct_url=<?>,disk_format='qcow2',id=45b8bf5e-667b-4182-9892-7fe510ef5a6e,min_disk=0,min_ram=0,name='tempest-scenario-img--1072434253',owner='626d22c8835e4819aadcf9cbe0180dc1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:28:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-93833120',display_name='tempest-TestMinimumBasicScenario-server-93833120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-93833120',id=35,image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM758e131dMxuNl5wHFcAlusORhJpbVnzGYf1ccWKH3iXrzjiJGIcx3BZglMNH3aP1aKQ+ua6ZbqcU5IcQfuG9/ttMb0Sy7ojyLXTo7plfC/Xw4YAsOnnm+epD4oTxnWHw==',key_name='tempest-TestMinimumBasicScenario-749627438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-q03r0rkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:28:56Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=0a3e352a-c299-457f-98f4-b237d37d08e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:28:58 user nova-compute[72992]:   <uuid>0a3e352a-c299-457f-98f4-b237d37d08e2</uuid>
Aug 15 21:28:58 user nova-compute[72992]:   <name>instance-00000023</name>
Aug 15 21:28:58 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:28:58 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:28:58 user nova-compute[72992]:   <metadata>
Aug 15 21:28:58 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:28:58 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:28:58 user nova-compute[72992]:       <nova:name>tempest-TestMinimumBasicScenario-server-93833120</nova:name>
Aug 15 21:28:58 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:28:58</nova:creationTime>
Aug 15 21:28:58 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:28:58 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:28:58 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:28:58 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:28:58 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:28:58 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:28:58 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:28:58 user nova-compute[72992]:       <nova:owner>
Aug 15 21:28:58 user nova-compute[72992]:         <nova:user uuid="478df679862f4c3a9887beb0fd2518c7">tempest-TestMinimumBasicScenario-543863856-project-member</nova:user>
Aug 15 21:28:58 user nova-compute[72992]:         <nova:project uuid="626d22c8835e4819aadcf9cbe0180dc1">tempest-TestMinimumBasicScenario-543863856</nova:project>
Aug 15 21:28:58 user nova-compute[72992]:       </nova:owner>
Aug 15 21:28:58 user nova-compute[72992]:       <nova:root type="image" uuid="45b8bf5e-667b-4182-9892-7fe510ef5a6e"/>
Aug 15 21:28:58 user nova-compute[72992]:       <nova:ports>
Aug 15 21:28:58 user nova-compute[72992]:         <nova:port uuid="377e089e-4e71-47ec-ba5c-bcd8f1f5b301">
Aug 15 21:28:58 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:28:58 user nova-compute[72992]:         </nova:port>
Aug 15 21:28:58 user nova-compute[72992]:       </nova:ports>
Aug 15 21:28:58 user nova-compute[72992]:     </nova:instance>
Aug 15 21:28:58 user nova-compute[72992]:   </metadata>
Aug 15 21:28:58 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:28:58 user nova-compute[72992]:     <system>
Aug 15 21:28:58 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:28:58 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:28:58 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:28:58 user nova-compute[72992]:       <entry name="serial">0a3e352a-c299-457f-98f4-b237d37d08e2</entry>
Aug 15 21:28:58 user nova-compute[72992]:       <entry name="uuid">0a3e352a-c299-457f-98f4-b237d37d08e2</entry>
Aug 15 21:28:58 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:28:58 user nova-compute[72992]:     </system>
Aug 15 21:28:58 user nova-compute[72992]:   </sysinfo>
Aug 15 21:28:58 user nova-compute[72992]:   <os>
Aug 15 21:28:58 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:28:58 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:28:58 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:28:58 user nova-compute[72992]:   </os>
Aug 15 21:28:58 user nova-compute[72992]:   <features>
Aug 15 21:28:58 user nova-compute[72992]:     <acpi/>
Aug 15 21:28:58 user nova-compute[72992]:     <apic/>
Aug 15 21:28:58 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:28:58 user nova-compute[72992]:   </features>
Aug 15 21:28:58 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:28:58 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:28:58 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:28:58 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:28:58 user nova-compute[72992]:   </clock>
Aug 15 21:28:58 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:28:58 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:28:58 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:28:58 user nova-compute[72992]:   </cpu>
Aug 15 21:28:58 user nova-compute[72992]:   <devices>
Aug 15 21:28:58 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:28:58 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:28:58 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk"/>
Aug 15 21:28:58 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:28:58 user nova-compute[72992]:     </disk>
Aug 15 21:28:58 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:28:58 user nova-compute[72992]:       <mac address="fa:16:3e:43:a8:5e"/>
Aug 15 21:28:58 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:28:58 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:28:58 user nova-compute[72992]:       <target dev="tap377e089e-4e"/>
Aug 15 21:28:58 user nova-compute[72992]:     </interface>
Aug 15 21:28:58 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:28:58 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/console.log" append="off"/>
Aug 15 21:28:58 user nova-compute[72992]:     </serial>
Aug 15 21:28:58 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:28:58 user nova-compute[72992]:     <video>
Aug 15 21:28:58 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:28:58 user nova-compute[72992]:     </video>
Aug 15 21:28:58 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:28:58 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:28:58 user nova-compute[72992]:     </rng>
Aug 15 21:28:58 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:28:58 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:28:58 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:28:58 user nova-compute[72992]:     </memballoon>
Aug 15 21:28:58 user nova-compute[72992]:   </devices>
Aug 15 21:28:58 user nova-compute[72992]: </domain>
Aug 15 21:28:58 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-93833120',display_name='tempest-TestMinimumBasicScenario-server-93833120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-93833120',id=35,image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM758e131dMxuNl5wHFcAlusORhJpbVnzGYf1ccWKH3iXrzjiJGIcx3BZglMNH3aP1aKQ+ua6ZbqcU5IcQfuG9/ttMb0Sy7ojyLXTo7plfC/Xw4YAsOnnm+epD4oTxnWHw==',key_name='tempest-TestMinimumBasicScenario-749627438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-q03r0rkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:28:56Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=0a3e352a-c299-457f-98f4-b237d37d08e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG os_vif [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap377e089e-4e, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap377e089e-4e, col_values=(('external_ids', {'iface-id': '377e089e-4e71-47ec-ba5c-bcd8f1f5b301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:a8:5e', 'vm-uuid': '0a3e352a-c299-457f-98f4-b237d37d08e2'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:28:58 user nova-compute[72992]: INFO os_vif [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e')
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No VIF found with MAC fa:16:3e:43:a8:5e, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:58 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Took 0.92 seconds to deallocate network for instance.
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG nova.network.neutron [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updated VIF entry in instance network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG nova.network.neutron [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c8028f05-f71a-4c1f-8833-6325fcb895af req-0060705f-d204-4060-8393-d85441c73389 service nova] Releasing lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-ac86d3cd-fcc3-48ef-96c4-bfa42f01cd5a req-2a3cb3e1-62ae-47aa-9827-62f0bef7513c service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received event network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ac86d3cd-fcc3-48ef-96c4-bfa42f01cd5a req-2a3cb3e1-62ae-47aa-9827-62f0bef7513c service nova] Acquiring lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ac86d3cd-fcc3-48ef-96c4-bfa42f01cd5a req-2a3cb3e1-62ae-47aa-9827-62f0bef7513c service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ac86d3cd-fcc3-48ef-96c4-bfa42f01cd5a req-2a3cb3e1-62ae-47aa-9827-62f0bef7513c service nova] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-ac86d3cd-fcc3-48ef-96c4-bfa42f01cd5a req-2a3cb3e1-62ae-47aa-9827-62f0bef7513c service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] No waiting events found dispatching network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:28:59 user nova-compute[72992]: WARNING nova.compute.manager [req-ac86d3cd-fcc3-48ef-96c4-bfa42f01cd5a req-2a3cb3e1-62ae-47aa-9827-62f0bef7513c service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received unexpected event network-vif-plugged-5fd0e113-1813-4231-996d-36ec3183e3d5 for instance with vm_state deleted and task_state None.
Aug 15 21:28:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:59 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Deleted allocations for instance 6e67b1bb-3b86-469e-88f4-da7c26d6ccef
Aug 15 21:28:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5c3fc4ce-778c-4364-a68a-26023f80a717 tempest-VolumesNegativeTest-1306736442 tempest-VolumesNegativeTest-1306736442-project-member] Lock "6e67b1bb-3b86-469e-88f4-da7c26d6ccef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:28:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-89be205b-4d07-4d5d-921e-f60990738e83 req-8083f62f-a2c2-4702-afe8-cbb3a55db49c service nova] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Received event network-vif-deleted-5fd0e113-1813-4231-996d-36ec3183e3d5 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:01 user nova-compute[72992]: WARNING nova.compute.manager [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received unexpected event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with vm_state building and task_state spawning.
Aug 15 21:29:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:01 user nova-compute[72992]: DEBUG nova.compute.manager [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:01 user nova-compute[72992]: WARNING nova.compute.manager [req-7855dd91-efb0-435f-9a85-14bf104a3a2d req-5dc8fe83-222e-41af-9017-6c1049bbc648 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received unexpected event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with vm_state building and task_state spawning.
Aug 15 21:29:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134942.3870492, 0a3e352a-c299-457f-98f4-b237d37d08e2 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:29:02 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] VM Resumed (Lifecycle Event)
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:29:02 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance spawned successfully.
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:02 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134942.3900895, 0a3e352a-c299-457f-98f4-b237d37d08e2 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:29:02 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] VM Started (Lifecycle Event)
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:29:02 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:29:02 user nova-compute[72992]: INFO nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 15 21:29:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:02 user nova-compute[72992]: INFO nova.compute.manager [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Took 7.47 seconds to build instance.
Aug 15 21:29:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-321faa91-adf5-4b96-83eb-636476b63ea8 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.567s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:06 user nova-compute[72992]: INFO nova.compute.manager [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Detaching volume 5da76655-c298-42f9-b7dc-98b6502c1de7
Aug 15 21:29:06 user nova-compute[72992]: INFO nova.virt.block_device [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Attempting to driver detach volume 5da76655-c298-42f9-b7dc-98b6502c1de7 from mountpoint /dev/vdc
Aug 15 21:29:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Attempting to detach device vdc from instance 4b290dce-4696-42ab-9b7b-fa36a6812481 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:29:06 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:29:06 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:29:06 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:29:06 user nova-compute[72992]:   <serial>5da76655-c298-42f9-b7dc-98b6502c1de7</serial>
Aug 15 21:29:06 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:29:06 user nova-compute[72992]: </disk>
Aug 15 21:29:06 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:29:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully detached device vdc from instance 4b290dce-4696-42ab-9b7b-fa36a6812481 from the persistent domain config.
Aug 15 21:29:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4b290dce-4696-42ab-9b7b-fa36a6812481 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:29:06 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:29:06 user nova-compute[72992]:   <source dev="/dev/sdf"/>
Aug 15 21:29:06 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:29:06 user nova-compute[72992]:   <serial>5da76655-c298-42f9-b7dc-98b6502c1de7</serial>
Aug 15 21:29:06 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:29:06 user nova-compute[72992]: </disk>
Aug 15 21:29:06 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692134946.805968, 4b290dce-4696-42ab-9b7b-fa36a6812481 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:29:06 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully detached device vdc from instance 4b290dce-4696-42ab-9b7b-fa36a6812481 from the live domain config.
Aug 15 21:29:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lzEqGCFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:29:06 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a270c3c5-bc6e-41d9-ab2d-1e9bf004baad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[184d24cc-4dab-40cc-bb3d-c5773b649f79]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:29:06 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:29:06 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:29:06 user nova-compute[72992]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)
Aug 15 21:29:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:29:06 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:29:06 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:29:06 user nova-compute[72992]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 (non-flash)
Aug 15 21:29:06 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0cb52fb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7'): ({'sdf'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Removing single pathed devices sdf {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:29:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ce978-38ef-4712-8c21-fc4c61a403ba]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[df78cbf0-97c1-4d49-b131-2fefbf709873]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flushing IO for device /dev/sdf {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd6a08d-8f89-4b3c-9435-b157e13da43b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f779999-c085-40ec-a8db-a1aea65116fc]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] SCSI volumes sdf have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4e80a3-fce5-4a48-b382-4620055b12c6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a787767-5683-4af0-bab2-361f2b0c8aa9]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260]
Aug 15 21:29:07 user nova-compute[72992]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7, portal: 172.16.0.220,3260] successful.
Aug 15 21:29:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5da76655-c298-42f9-b7dc-98b6502c1de7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4696fe15-d0c6-4b3e-b5e0-275ed07539a2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] <== disconnect_volume: return (310ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:29:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'flavor' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:29:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-233d350e-3ed3-4443-802e-9925963ae7c8 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.820s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:29:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:29:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:12 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134937.630976, 6e67b1bb-3b86-469e-88f4-da7c26d6ccef => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:29:12 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] VM Stopped (Lifecycle Event)
Aug 15 21:29:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4b452384-14a7-4996-840c-905f53c96b7c None None] [instance: 6e67b1bb-3b86-469e-88f4-da7c26d6ccef] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:17 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:17 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:29:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:29:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:29:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:29:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7232MB free_disk=25.108238220214844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:29:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e52158f6-519d-4a8f-99d6-756e64385366 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance aa27d011-e6f9-4a7c-9d06-6633aa933094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4b290dce-4696-42ab-9b7b-fa36a6812481 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0a3e352a-c299-457f-98f4-b237d37d08e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.848s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:29:23 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updating instance_info_cache with network_info: [{"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e52158f6-519d-4a8f-99d6-756e64385366" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:29:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:29:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:29:35 user nova-compute[72992]: INFO nova.compute.claims [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Claim successful on node user
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.network.neutron [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:29:35 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.policy [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ef12285747c4725a57499fa6efa0e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c51e2c9da4e6ba1f689375f57f21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:29:35 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Creating image(s)
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "/opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "/opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "/opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk 1073741824" returned: 0 in 0.065s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Successfully created port: 00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Cannot resize image /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG nova.objects.instance [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lazy-loading 'migration_context' on Instance uuid a646f27e-7c66-4b37-aaa0-ddb908524e63 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Ensure instance console log exists: /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Successfully updated port: 00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "refresh_cache-a646f27e-7c66-4b37-aaa0-ddb908524e63" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquired lock "refresh_cache-a646f27e-7c66-4b37-aaa0-ddb908524e63" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-changed-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.compute.manager [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Refreshing instance network info cache due to event network-changed-00783325-0df5-494f-abe5-b201ae42062b. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] Acquiring lock "refresh_cache-a646f27e-7c66-4b37-aaa0-ddb908524e63" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Updating instance_info_cache with network_info: [{"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Releasing lock "refresh_cache-a646f27e-7c66-4b37-aaa0-ddb908524e63" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Instance network_info: |[{"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] Acquired lock "refresh_cache-a646f27e-7c66-4b37-aaa0-ddb908524e63" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.neutron [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Refreshing network info cache for port 00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Start _get_guest_xml network_info=[{"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:29:37 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:29:37 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-654216175',display_name='tempest-VolumesActionsTest-instance-654216175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-654216175',id=36,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a0c51e2c9da4e6ba1f689375f57f21a',ramdisk_id='',reservation_id='r-qdrx8lvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-175706456',owner_user_name='tempest-VolumesActionsTest-175706456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:29:36Z,user_data=None,user_id='0ef12285747c4725a57499fa6efa0e31',uuid=a646f27e-7c66-4b37-aaa0-ddb908524e63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converting VIF {"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:f0,bridge_name='br-int',has_traffic_filtering=True,id=00783325-0df5-494f-abe5-b201ae42062b,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00783325-0d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.objects.instance [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lazy-loading 'pci_devices' on Instance uuid a646f27e-7c66-4b37-aaa0-ddb908524e63 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:29:37 user nova-compute[72992]:   <uuid>a646f27e-7c66-4b37-aaa0-ddb908524e63</uuid>
Aug 15 21:29:37 user nova-compute[72992]:   <name>instance-00000024</name>
Aug 15 21:29:37 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:29:37 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:29:37 user nova-compute[72992]:   <metadata>
Aug 15 21:29:37 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:29:37 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:29:37 user nova-compute[72992]:       <nova:name>tempest-VolumesActionsTest-instance-654216175</nova:name>
Aug 15 21:29:37 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:29:37</nova:creationTime>
Aug 15 21:29:37 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:29:37 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:29:37 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:29:37 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:29:37 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:29:37 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:29:37 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:29:37 user nova-compute[72992]:       <nova:owner>
Aug 15 21:29:37 user nova-compute[72992]:         <nova:user uuid="0ef12285747c4725a57499fa6efa0e31">tempest-VolumesActionsTest-175706456-project-member</nova:user>
Aug 15 21:29:37 user nova-compute[72992]:         <nova:project uuid="0a0c51e2c9da4e6ba1f689375f57f21a">tempest-VolumesActionsTest-175706456</nova:project>
Aug 15 21:29:37 user nova-compute[72992]:       </nova:owner>
Aug 15 21:29:37 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:29:37 user nova-compute[72992]:       <nova:ports>
Aug 15 21:29:37 user nova-compute[72992]:         <nova:port uuid="00783325-0df5-494f-abe5-b201ae42062b">
Aug 15 21:29:37 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 21:29:37 user nova-compute[72992]:         </nova:port>
Aug 15 21:29:37 user nova-compute[72992]:       </nova:ports>
Aug 15 21:29:37 user nova-compute[72992]:     </nova:instance>
Aug 15 21:29:37 user nova-compute[72992]:   </metadata>
Aug 15 21:29:37 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:29:37 user nova-compute[72992]:     <system>
Aug 15 21:29:37 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:29:37 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:29:37 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:29:37 user nova-compute[72992]:       <entry name="serial">a646f27e-7c66-4b37-aaa0-ddb908524e63</entry>
Aug 15 21:29:37 user nova-compute[72992]:       <entry name="uuid">a646f27e-7c66-4b37-aaa0-ddb908524e63</entry>
Aug 15 21:29:37 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:29:37 user nova-compute[72992]:     </system>
Aug 15 21:29:37 user nova-compute[72992]:   </sysinfo>
Aug 15 21:29:37 user nova-compute[72992]:   <os>
Aug 15 21:29:37 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:29:37 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:29:37 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:29:37 user nova-compute[72992]:   </os>
Aug 15 21:29:37 user nova-compute[72992]:   <features>
Aug 15 21:29:37 user nova-compute[72992]:     <acpi/>
Aug 15 21:29:37 user nova-compute[72992]:     <apic/>
Aug 15 21:29:37 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:29:37 user nova-compute[72992]:   </features>
Aug 15 21:29:37 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:29:37 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:29:37 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:29:37 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:29:37 user nova-compute[72992]:   </clock>
Aug 15 21:29:37 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:29:37 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:29:37 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:29:37 user nova-compute[72992]:   </cpu>
Aug 15 21:29:37 user nova-compute[72992]:   <devices>
Aug 15 21:29:37 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:29:37 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:29:37 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk"/>
Aug 15 21:29:37 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:29:37 user nova-compute[72992]:     </disk>
Aug 15 21:29:37 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:29:37 user nova-compute[72992]:       <mac address="fa:16:3e:86:5c:f0"/>
Aug 15 21:29:37 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:29:37 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:29:37 user nova-compute[72992]:       <target dev="tap00783325-0d"/>
Aug 15 21:29:37 user nova-compute[72992]:     </interface>
Aug 15 21:29:37 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:29:37 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/console.log" append="off"/>
Aug 15 21:29:37 user nova-compute[72992]:     </serial>
Aug 15 21:29:37 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:29:37 user nova-compute[72992]:     <video>
Aug 15 21:29:37 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:29:37 user nova-compute[72992]:     </video>
Aug 15 21:29:37 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:29:37 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:29:37 user nova-compute[72992]:     </rng>
Aug 15 21:29:37 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:29:37 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:29:37 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:29:37 user nova-compute[72992]:     </memballoon>
Aug 15 21:29:37 user nova-compute[72992]:   </devices>
Aug 15 21:29:37 user nova-compute[72992]: </domain>
Aug 15 21:29:37 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-654216175',display_name='tempest-VolumesActionsTest-instance-654216175',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-654216175',id=36,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a0c51e2c9da4e6ba1f689375f57f21a',ramdisk_id='',reservation_id='r-qdrx8lvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-175706456',owner_user_name='tempest-VolumesActionsTest-175706456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:29:36Z,user_data=None,user_id='0ef12285747c4725a57499fa6efa0e31',uuid=a646f27e-7c66-4b37-aaa0-ddb908524e63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converting VIF {"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:f0,bridge_name='br-int',has_traffic_filtering=True,id=00783325-0df5-494f-abe5-b201ae42062b,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00783325-0d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG os_vif [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:f0,bridge_name='br-int',has_traffic_filtering=True,id=00783325-0df5-494f-abe5-b201ae42062b,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00783325-0d') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00783325-0d, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00783325-0d, col_values=(('external_ids', {'iface-id': '00783325-0df5-494f-abe5-b201ae42062b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:5c:f0', 'vm-uuid': 'a646f27e-7c66-4b37-aaa0-ddb908524e63'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:37 user nova-compute[72992]: INFO os_vif [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:f0,bridge_name='br-int',has_traffic_filtering=True,id=00783325-0df5-494f-abe5-b201ae42062b,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00783325-0d')
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] No VIF found with MAC fa:16:3e:86:5c:f0, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.neutron [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Updated VIF entry in instance network info cache for port 00783325-0df5-494f-abe5-b201ae42062b. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG nova.network.neutron [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Updating instance_info_cache with network_info: [{"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:29:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9f75b091-06a7-4cc4-a031-fefdbe448d38 req-76ba89b0-a240-4801-be35-7542dca23a42 service nova] Releasing lock "refresh_cache-a646f27e-7c66-4b37-aaa0-ddb908524e63" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:29:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-94614aff-fa29-45ca-8a1c-1352a891fd3e req-87718c53-4684-4549-8bfe-957da39f7149 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-94614aff-fa29-45ca-8a1c-1352a891fd3e req-87718c53-4684-4549-8bfe-957da39f7149 service nova] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-94614aff-fa29-45ca-8a1c-1352a891fd3e req-87718c53-4684-4549-8bfe-957da39f7149 service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-94614aff-fa29-45ca-8a1c-1352a891fd3e req-87718c53-4684-4549-8bfe-957da39f7149 service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-94614aff-fa29-45ca-8a1c-1352a891fd3e req-87718c53-4684-4549-8bfe-957da39f7149 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] No waiting events found dispatching network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:39 user nova-compute[72992]: WARNING nova.compute.manager [req-94614aff-fa29-45ca-8a1c-1352a891fd3e req-87718c53-4684-4549-8bfe-957da39f7149 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received unexpected event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b for instance with vm_state building and task_state spawning.
Aug 15 21:29:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-782dcf5b-768c-47d3-8e63-360cd515dc7d req-ad1888cd-262c-44e0-85d1-2bc1a563cd24 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-782dcf5b-768c-47d3-8e63-360cd515dc7d req-ad1888cd-262c-44e0-85d1-2bc1a563cd24 service nova] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-782dcf5b-768c-47d3-8e63-360cd515dc7d req-ad1888cd-262c-44e0-85d1-2bc1a563cd24 service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-782dcf5b-768c-47d3-8e63-360cd515dc7d req-ad1888cd-262c-44e0-85d1-2bc1a563cd24 service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-782dcf5b-768c-47d3-8e63-360cd515dc7d req-ad1888cd-262c-44e0-85d1-2bc1a563cd24 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] No waiting events found dispatching network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:41 user nova-compute[72992]: WARNING nova.compute.manager [req-782dcf5b-768c-47d3-8e63-360cd515dc7d req-ad1888cd-262c-44e0-85d1-2bc1a563cd24 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received unexpected event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b for instance with vm_state building and task_state spawning.
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134981.4474247, a646f27e-7c66-4b37-aaa0-ddb908524e63 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:29:41 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] VM Resumed (Lifecycle Event)
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:29:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Instance spawned successfully.
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:29:41 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692134981.4510388, a646f27e-7c66-4b37-aaa0-ddb908524e63 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:29:41 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] VM Started (Lifecycle Event)
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:29:41 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:29:41 user nova-compute[72992]: INFO nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 15 21:29:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:41 user nova-compute[72992]: INFO nova.compute.manager [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Took 6.66 seconds to build instance.
Aug 15 21:29:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-55d30085-4d1c-4994-a7e6-57addd8301fb tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.754s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "e52158f6-519d-4a8f-99d6-756e64385366" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:42 user nova-compute[72992]: INFO nova.compute.manager [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Terminating instance
Aug 15 21:29:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-20eb1586-ba45-4e17-9530-cf11221350f7 req-f9891cce-bb4d-4156-9ba3-ac219c4c413d service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-unplugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-20eb1586-ba45-4e17-9530-cf11221350f7 req-f9891cce-bb4d-4156-9ba3-ac219c4c413d service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-20eb1586-ba45-4e17-9530-cf11221350f7 req-f9891cce-bb4d-4156-9ba3-ac219c4c413d service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-20eb1586-ba45-4e17-9530-cf11221350f7 req-f9891cce-bb4d-4156-9ba3-ac219c4c413d service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-20eb1586-ba45-4e17-9530-cf11221350f7 req-f9891cce-bb4d-4156-9ba3-ac219c4c413d service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-unplugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-20eb1586-ba45-4e17-9530-cf11221350f7 req-f9891cce-bb4d-4156-9ba3-ac219c4c413d service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-unplugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Instance destroyed successfully.
Aug 15 21:29:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'resources' on Instance uuid e52158f6-519d-4a8f-99d6-756e64385366 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1286787809',display_name='tempest-ServerRescueNegativeTestJSON-server-1286787809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1286787809',id=6,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:15:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-hocp9kpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:16Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=e52158f6-519d-4a8f-99d6-756e64385366,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "address": "fa:16:3e:97:bb:5a", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e7c808f-e1", "ovs_interfaceid": "0e7c808f-e1b0-4b77-a5e8-818aa10f314c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG os_vif [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e7c808f-e1, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:43 user nova-compute[72992]: INFO os_vif [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:bb:5a,bridge_name='br-int',has_traffic_filtering=True,id=0e7c808f-e1b0-4b77-a5e8-818aa10f314c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e7c808f-e1')
Aug 15 21:29:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Deleting instance files /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366_del
Aug 15 21:29:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Deletion of /opt/stack/data/nova/instances/e52158f6-519d-4a8f-99d6-756e64385366_del complete
Aug 15 21:29:43 user nova-compute[72992]: INFO nova.compute.manager [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 21:29:43 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:29:43 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:29:44 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Took 0.54 seconds to deallocate network for instance.
Aug 15 21:29:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-48d425cd-8cc5-40f3-8639-887e9cc802a7 req-f5d06336-d29a-4213-be5d-116443eac715 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-deleted-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:44 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Deleted allocations for instance e52158f6-519d-4a8f-99d6-756e64385366
Aug 15 21:29:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28217081-f4e4-49c6-b1b7-069850c2bd44 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "e52158f6-519d-4a8f-99d6-756e64385366" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0d4c3ac-1b82-499c-a941-443b0db18632 req-202ad7df-2c7c-49b9-b0a7-2f495e660808 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d4c3ac-1b82-499c-a941-443b0db18632 req-202ad7df-2c7c-49b9-b0a7-2f495e660808 service nova] Acquiring lock "e52158f6-519d-4a8f-99d6-756e64385366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d4c3ac-1b82-499c-a941-443b0db18632 req-202ad7df-2c7c-49b9-b0a7-2f495e660808 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0d4c3ac-1b82-499c-a941-443b0db18632 req-202ad7df-2c7c-49b9-b0a7-2f495e660808 service nova] Lock "e52158f6-519d-4a8f-99d6-756e64385366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0d4c3ac-1b82-499c-a941-443b0db18632 req-202ad7df-2c7c-49b9-b0a7-2f495e660808 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] No waiting events found dispatching network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:44 user nova-compute[72992]: WARNING nova.compute.manager [req-e0d4c3ac-1b82-499c-a941-443b0db18632 req-202ad7df-2c7c-49b9-b0a7-2f495e660808 service nova] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Received unexpected event network-vif-plugged-0e7c808f-e1b0-4b77-a5e8-818aa10f314c for instance with vm_state deleted and task_state None.
Aug 15 21:29:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-changed-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Refreshing instance network info cache due to event network-changed-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] Acquiring lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] Acquired lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Refreshing network info cache for port e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updated VIF entry in instance network info cache for port e39d6d79-a4a7-461c-9f11-14be5d7fd5ee. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG nova.network.neutron [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating instance_info_cache with network_info: [{"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:29:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-32a11e95-a272-4048-8673-e1f2055385d2 req-9079b26d-534d-43fd-b799-7e16a5954ba1 service nova] Releasing lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:29:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:54 user nova-compute[72992]: DEBUG nova.objects.instance [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:29:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:55 user nova-compute[72992]: INFO nova.compute.manager [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attaching volume 8e710723-04b8-4f78-b5f0-701d0584c025 to /dev/vdb
Aug 15 21:29:55 user nova-compute[72992]: DEBUG os_brick.utils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f6225-7708-4b89-97eb-806040332475]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f7883c-2d6a-407b-b0fc-74066199cce2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[487600f7-3d7d-433b-8d6d-2be3e82dacde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd965bbf-f4c8-4733-81b6-84353b1e7a09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:29:55 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:29:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea56e33-5da9-4c13-b316-7b85d5cde2ed]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG os_brick.utils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:29:55 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating existing volume attachment record: a8302ed4-c03f-4442-8d25-0b9621e27abb {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:56 user nova-compute[72992]: INFO nova.compute.manager [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Terminating instance
Aug 15 21:29:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-63eef59f-be9c-4fe1-9573-e58dca5a8827 req-1afa1511-297a-44a4-a6b9-fa8ecc2aff98 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-unplugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63eef59f-be9c-4fe1-9573-e58dca5a8827 req-1afa1511-297a-44a4-a6b9-fa8ecc2aff98 service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63eef59f-be9c-4fe1-9573-e58dca5a8827 req-1afa1511-297a-44a4-a6b9-fa8ecc2aff98 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-63eef59f-be9c-4fe1-9573-e58dca5a8827 req-1afa1511-297a-44a4-a6b9-fa8ecc2aff98 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-63eef59f-be9c-4fe1-9573-e58dca5a8827 req-1afa1511-297a-44a4-a6b9-fa8ecc2aff98 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-unplugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:56 user nova-compute[72992]: DEBUG nova.compute.manager [req-63eef59f-be9c-4fe1-9573-e58dca5a8827 req-1afa1511-297a-44a4-a6b9-fa8ecc2aff98 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-unplugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:29:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Instance destroyed successfully.
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'resources' on Instance uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:23:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1819635464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1819635464',id=27,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwbZznfDDGD0iZIucT6QHthsMyTBp+iA4rK6C3Vo5rzePxuQwULUvNhbFZLK1Q2Dy7XO1TMTfA4CVUIoMgfaQNS+A4I4GY1atSalYH+J29ji0QmsjasrLCyTLhFBp7RBQ==',key_name='tempest-keypair-903603687',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:27:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-4tuo9m5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:27:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=4b290dce-4696-42ab-9b7b-fa36a6812481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "e4038664-f682-4738-afe1-42891cbda0c6", "address": "fa:16:3e:1f:c9:72", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4038664-f6", "ovs_interfaceid": "e4038664-f682-4738-afe1-42891cbda0c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG os_vif [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4038664-f6, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:57 user nova-compute[72992]: INFO os_vif [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:c9:72,bridge_name='br-int',has_traffic_filtering=True,id=e4038664-f682-4738-afe1-42891cbda0c6,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4038664-f6')
Aug 15 21:29:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Deleting instance files /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481_del
Aug 15 21:29:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Deletion of /opt/stack/data/nova/instances/4b290dce-4696-42ab-9b7b-fa36a6812481_del complete
Aug 15 21:29:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:29:57 user nova-compute[72992]: INFO nova.compute.manager [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:29:57 user nova-compute[72992]: WARNING nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 217026e1-b750-4861-8806-f0d87eaabb45 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid e0710ccf-1252-4d29-9b9c-65d0102e20c3 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 0e1af659-08bc-4097-bcb3-12c14816d6ee {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 18dca40c-2589-4fca-97db-5f88e88c7d09 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 4b290dce-4696-42ab-9b7b-fa36a6812481 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid a646f27e-7c66-4b37-aaa0-ddb908524e63 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "217026e1-b750-4861-8806-f0d87eaabb45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "217026e1-b750-4861-8806-f0d87eaabb45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134983.4762957, e52158f6-519d-4a8f-99d6-756e64385366 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:29:58 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e52158f6-519d-4a8f-99d6-756e64385366] VM Stopped (Lifecycle Event)
Aug 15 21:29:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-040a8a9a-1d16-4b25-a730-59f0522f69e9 None None] [instance: e52158f6-519d-4a8f-99d6-756e64385366] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:29:58 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Took 1.39 seconds to deallocate network for instance.
Aug 15 21:29:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-95c54842-0d8b-4a8e-8f6d-c535353b455f req-b56ed6a4-c366-4ec3-86aa-747e38c53df5 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-95c54842-0d8b-4a8e-8f6d-c535353b455f req-b56ed6a4-c366-4ec3-86aa-747e38c53df5 service nova] Acquiring lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-95c54842-0d8b-4a8e-8f6d-c535353b455f req-b56ed6a4-c366-4ec3-86aa-747e38c53df5 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-95c54842-0d8b-4a8e-8f6d-c535353b455f req-b56ed6a4-c366-4ec3-86aa-747e38c53df5 service nova] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-95c54842-0d8b-4a8e-8f6d-c535353b455f req-b56ed6a4-c366-4ec3-86aa-747e38c53df5 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] No waiting events found dispatching network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:29:58 user nova-compute[72992]: WARNING nova.compute.manager [req-95c54842-0d8b-4a8e-8f6d-c535353b455f req-b56ed6a4-c366-4ec3-86aa-747e38c53df5 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received unexpected event network-vif-plugged-e4038664-f682-4738-afe1-42891cbda0c6 for instance with vm_state deleted and task_state None.
Aug 15 21:29:58 user nova-compute[72992]: DEBUG nova.compute.manager [req-95c54842-0d8b-4a8e-8f6d-c535353b455f req-b56ed6a4-c366-4ec3-86aa-747e38c53df5 service nova] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Received event network-vif-deleted-e4038664-f682-4738-afe1-42891cbda0c6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:29:59 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:29:59 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:29:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:59 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Deleted allocations for instance 4b290dce-4696-42ab-9b7b-fa36a6812481
Aug 15 21:29:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1b07532b-db02-43d5-97aa-51cc3897cb85 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:29:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.563s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:29:59 user nova-compute[72992]: INFO nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 15 21:29:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "4b290dce-4696-42ab-9b7b-fa36a6812481" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:00 user nova-compute[72992]: INFO nova.compute.manager [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Detaching volume fa6d5f18-59ce-4e9f-9572-59fc33e205ae
Aug 15 21:30:00 user nova-compute[72992]: INFO nova.virt.block_device [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Attempting to driver detach volume fa6d5f18-59ce-4e9f-9572-59fc33e205ae from mountpoint /dev/vdb
Aug 15 21:30:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Attempting to detach device vdb from instance aa27d011-e6f9-4a7c-9d06-6633aa933094 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:30:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:30:00 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:30:00 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:30:00 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:30:00 user nova-compute[72992]:   <serial>fa6d5f18-59ce-4e9f-9572-59fc33e205ae</serial>
Aug 15 21:30:00 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:30:00 user nova-compute[72992]: </disk>
Aug 15 21:30:00 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:30:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully detached device vdb from instance aa27d011-e6f9-4a7c-9d06-6633aa933094 from the persistent domain config.
Aug 15 21:30:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa27d011-e6f9-4a7c-9d06-6633aa933094 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:30:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:30:00 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:30:00 user nova-compute[72992]:   <source dev="/dev/sde"/>
Aug 15 21:30:00 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:30:00 user nova-compute[72992]:   <serial>fa6d5f18-59ce-4e9f-9572-59fc33e205ae</serial>
Aug 15 21:30:00 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:30:00 user nova-compute[72992]: </disk>
Aug 15 21:30:00 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135001.2656496, aa27d011-e6f9-4a7c-9d06-6633aa933094 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:30:01 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully detached device vdb from instance aa27d011-e6f9-4a7c-9d06-6633aa933094 from the live domain config.
Aug 15 21:30:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yzdEutlm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:30:01 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bc185c-93ab-42e9-995a-2f52bf64554b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2e533c-ce00-4191-beeb-573d6db3dc14]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:01 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:01 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:30:01 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:01 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:01 user nova-compute[72992]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae (non-flash)
Aug 15 21:30:01 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c85b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae'): ({'sde'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Removing single pathed devices sde {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f684d-34f8-4895-a880-71cab5debafe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c2f9b3-f757-45a7-840d-2a17fce5416a]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flushing IO for device /dev/sde {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1272a3c-d704-44db-893c-2bcf8227ff9d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[720c0659-774d-4115-9e2a-807761d517a2]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] SCSI volumes sde have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc26ed-080d-4fe7-854b-096d5c768bfa]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d619c6-596a-40f2-b3d1-affc5acb5a94]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260]
Aug 15 21:30:01 user nova-compute[72992]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae, portal: 172.16.0.220,3260] successful.
Aug 15 21:30:01 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa6d5f18-59ce-4e9f-9572-59fc33e205ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[42089146-bf54-4064-8100-0b326a390f49]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== disconnect_volume: return (299ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:30:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:30:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:02 user nova-compute[72992]: DEBUG nova.objects.instance [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'flavor' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-84ab77f5-5912-4947-a74b-89e7171d045d tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.769s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHLtfkVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:30:07 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:30:07 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:30:07 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a831b35-7d41-49c8-9e5f-2aac849388c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:30:07 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e3664b-66a0-43bd-8e40-8d59e9395c3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025] added
Aug 15 21:30:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee1c8a3-d2e4-4bfe-8de8-3e147ed3bc80]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d3ce0c-69e8-438e-9ff1-53724876b340]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHLtfkVC {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rHLtfkVC" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f9aed-b68e-4da6-8101-23fb31babf88]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rHLtfkVC'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[033bdeba-af53-4e8a-9694-0981e1f0abb9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf06b03-dd5d-4d99-a70f-f6bb74b92f0c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[208c3747-7b52-4275-acb1-2107169e1e71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260]
Aug 15 21:30:07 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260] successful.
Aug 15 21:30:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[249bcfae-5ec7-4db0-8c92-a9b4e08a951b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d91a9f7-2fc8-4e49-8e03-32c88395f601]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:07 user nova-compute[72992]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)
Aug 15 21:30:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:07 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:07 user nova-compute[72992]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)
Aug 15 21:30:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:30:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:30:08 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:30:08 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:30:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:08 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a124bf-8559-4dc6-af9a-6fcd5e581812]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:08 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:30:08 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHLtfkVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23437336535633161', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437336535633161', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:30:09 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:30:09 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:30:09 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:30:09 user nova-compute[72992]:   <serial>8e710723-04b8-4f78-b5f0-701d0584c025</serial>
Aug 15 21:30:09 user nova-compute[72992]: </disk>
Aug 15 21:30:09 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No VIF found with MAC fa:16:3e:75:66:b5, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-cb81148b-f1c7-4522-b756-9e9392cf69bd tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.465s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.692s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:12 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692134997.3701923, 4b290dce-4696-42ab-9b7b-fa36a6812481 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:30:12 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] VM Stopped (Lifecycle Event)
Aug 15 21:30:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aea0b85d-cb24-45d4-a9ac-95eff6b51911 None None] [instance: 4b290dce-4696-42ab-9b7b-fa36a6812481] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:30:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:17 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:18 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:18 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:18 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:30:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:21 user nova-compute[72992]: INFO nova.compute.manager [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Terminating instance
Aug 15 21:30:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-a8035c25-437d-4c80-a27a-a12437a589b4 req-e6cbdc55-e182-4529-a1fd-22033326a9db service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8035c25-437d-4c80-a27a-a12437a589b4 req-e6cbdc55-e182-4529-a1fd-22033326a9db service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8035c25-437d-4c80-a27a-a12437a589b4 req-e6cbdc55-e182-4529-a1fd-22033326a9db service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a8035c25-437d-4c80-a27a-a12437a589b4 req-e6cbdc55-e182-4529-a1fd-22033326a9db service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-a8035c25-437d-4c80-a27a-a12437a589b4 req-e6cbdc55-e182-4529-a1fd-22033326a9db service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-a8035c25-437d-4c80-a27a-a12437a589b4 req-e6cbdc55-e182-4529-a1fd-22033326a9db service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-unplugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:30:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7264MB free_disk=25.122421264648438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Instance destroyed successfully.
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'resources' on Instance uuid e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:24:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219868108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219868108',id=31,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-ish0ghuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:28:36Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "c4083799-faf5-41d9-9893-64913d8f1da8", "address": "fa:16:3e:73:f8:45", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4083799-fa", "ovs_interfaceid": "c4083799-faf5-41d9-9893-64913d8f1da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_vif [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4083799-fa, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:30:23 user nova-compute[72992]: INFO os_vif [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f8:45,bridge_name='br-int',has_traffic_filtering=True,id=c4083799-faf5-41d9-9893-64913d8f1da8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4083799-fa')
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'injEeoyF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:30:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac1d78a-4c59-4177-a317-a259bfb235fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1420f1a1-a472-4fb0-a772-c43f2aed1651]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:23 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:23 user nova-compute[72992]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)
Aug 15 21:30:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:23 user nova-compute[72992]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a (non-flash)
Aug 15 21:30:23 user nova-compute[72992]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)
Aug 15 21:30:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c84c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a6e7c604-49e8-47af-a81f-2da89401ea96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 18dca40c-2589-4fca-97db-5f88e88c7d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance aa27d011-e6f9-4a7c-9d06-6633aa933094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0a3e352a-c299-457f-98f4-b237d37d08e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a646f27e-7c66-4b37-aaa0-ddb908524e63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156016e-c06b-4a15-93b4-4514cc4408a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[658b9332-6681-4cf5-a2d3-aa120303aa72]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bf5609-5c35-4f99-bef8-122fd8c1d20c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[662879af-f9b9-4c43-a8aa-286306114e33]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[628c6535-115e-4e1a-8622-8de81b146ba3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[166fd366-7cd8-4dc4-9321-321d9991838a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260]
Aug 15 21:30:23 user nova-compute[72992]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a, portal: 172.16.0.220,3260] successful.
Aug 15 21:30:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da17aa4-252a-4007-80b3-fcc03437952a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4781159-0992-4669-b1e9-c56913c560d8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== disconnect_volume: return (313ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:30:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Deleting instance files /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9_del
Aug 15 21:30:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Deletion of /opt/stack/data/nova/instances/e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9_del complete
Aug 15 21:30:23 user nova-compute[72992]: INFO nova.compute.manager [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Took 1.73 seconds to destroy the instance on the hypervisor.
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:30:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:24 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:24 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Took 0.60 seconds to deallocate network for instance.
Aug 15 21:30:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-26aaf93d-79fd-4fe3-874c-93b9cc837a16 req-04b0dda3-dac7-4726-b3b0-a0921189f162 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-deleted-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:24 user nova-compute[72992]: INFO nova.compute.manager [req-26aaf93d-79fd-4fe3-874c-93b9cc837a16 req-04b0dda3-dac7-4726-b3b0-a0921189f162 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Neutron deleted interface c4083799-faf5-41d9-9893-64913d8f1da8; detaching it from the instance and deleting it from the info cache
Aug 15 21:30:24 user nova-compute[72992]: DEBUG nova.network.neutron [req-26aaf93d-79fd-4fe3-874c-93b9cc837a16 req-04b0dda3-dac7-4726-b3b0-a0921189f162 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-26aaf93d-79fd-4fe3-874c-93b9cc837a16 req-04b0dda3-dac7-4726-b3b0-a0921189f162 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Detach interface failed, port_id=c4083799-faf5-41d9-9893-64913d8f1da8, reason: Instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:30:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-28be5ba6-7d94-4d6d-be1b-166ac13a1cba req-2c4779e6-9061-4492-9f80-d91fd7dbdec9 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-28be5ba6-7d94-4d6d-be1b-166ac13a1cba req-2c4779e6-9061-4492-9f80-d91fd7dbdec9 service nova] Acquiring lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-28be5ba6-7d94-4d6d-be1b-166ac13a1cba req-2c4779e6-9061-4492-9f80-d91fd7dbdec9 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-28be5ba6-7d94-4d6d-be1b-166ac13a1cba req-2c4779e6-9061-4492-9f80-d91fd7dbdec9 service nova] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:24 user nova-compute[72992]: DEBUG nova.compute.manager [req-28be5ba6-7d94-4d6d-be1b-166ac13a1cba req-2c4779e6-9061-4492-9f80-d91fd7dbdec9 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] No waiting events found dispatching network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:24 user nova-compute[72992]: WARNING nova.compute.manager [req-28be5ba6-7d94-4d6d-be1b-166ac13a1cba req-2c4779e6-9061-4492-9f80-d91fd7dbdec9 service nova] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Received unexpected event network-vif-plugged-c4083799-faf5-41d9-9893-64913d8f1da8 for instance with vm_state active and task_state deleting.
Aug 15 21:30:25 user nova-compute[72992]: INFO nova.compute.manager [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Took 0.94 seconds to detach 1 volumes for instance.
Aug 15 21:30:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:25 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:30:25 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:30:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:25 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Deleted allocations for instance e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9
Aug 15 21:30:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4abc6ccc-b4af-435e-a19e-1e6b9d64ff69 tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.857s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:30:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:30:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:30:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:30:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating instance_info_cache with network_info: [{"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-76c6d54f-938e-42a0-84d6-659e38f21bb8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:30:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:30:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:30:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:30:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:33 user nova-compute[72992]: INFO nova.compute.manager [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Terminating instance
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-bb03cd2b-dbad-4bf3-b4bc-8ff9f835dd89 req-5450ff15-e075-4101-a172-48da106ee367 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bb03cd2b-dbad-4bf3-b4bc-8ff9f835dd89 req-5450ff15-e075-4101-a172-48da106ee367 service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bb03cd2b-dbad-4bf3-b4bc-8ff9f835dd89 req-5450ff15-e075-4101-a172-48da106ee367 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bb03cd2b-dbad-4bf3-b4bc-8ff9f835dd89 req-5450ff15-e075-4101-a172-48da106ee367 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-bb03cd2b-dbad-4bf3-b4bc-8ff9f835dd89 req-5450ff15-e075-4101-a172-48da106ee367 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-bb03cd2b-dbad-4bf3-b4bc-8ff9f835dd89 req-5450ff15-e075-4101-a172-48da106ee367 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-unplugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:30:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Instance destroyed successfully.
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lazy-loading 'resources' on Instance uuid a6e7c604-49e8-47af-a81f-2da89401ea96 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-976509570',display_name='tempest-ServerRescueNegativeTestJSON-server-976509570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-976509570',id=3,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='664606f930f446fabae71df899c94da5',ramdisk_id='',reservation_id='r-pu00chv5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-600517153',owner_user_name='tempest-ServerRescueNegativeTestJSON-600517153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:20:01Z,user_data=None,user_id='08a032f1741f46ee814186f61b82aac4',uuid=a6e7c604-49e8-47af-a81f-2da89401ea96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converting VIF {"id": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "address": "fa:16:3e:68:1e:f7", "network": {"id": "ef9051a6-f070-4598-bbcf-a23b409f4cfe", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1193437253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "664606f930f446fabae71df899c94da5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0331ed5-51", "ovs_interfaceid": "a0331ed5-5162-4b9a-bb4e-9f28a4657d6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG os_vif [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0331ed5-51, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:33 user nova-compute[72992]: INFO os_vif [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:1e:f7,bridge_name='br-int',has_traffic_filtering=True,id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c,network=Network(ef9051a6-f070-4598-bbcf-a23b409f4cfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0331ed5-51')
Aug 15 21:30:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Deleting instance files /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96_del
Aug 15 21:30:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Deletion of /opt/stack/data/nova/instances/a6e7c604-49e8-47af-a81f-2da89401ea96_del complete
Aug 15 21:30:34 user nova-compute[72992]: INFO nova.compute.manager [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 21:30:34 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:30:34 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:30:34 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:30:34 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:34 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Took 0.58 seconds to deallocate network for instance.
Aug 15 21:30:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b183b46a-8160-40d5-a120-64051e5af42d req-b3dde5e7-28ca-46aa-84fd-8e8f50efebea service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-deleted-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:34 user nova-compute[72992]: INFO nova.compute.manager [req-b183b46a-8160-40d5-a120-64051e5af42d req-b3dde5e7-28ca-46aa-84fd-8e8f50efebea service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Neutron deleted interface a0331ed5-5162-4b9a-bb4e-9f28a4657d6c; detaching it from the instance and deleting it from the info cache
Aug 15 21:30:34 user nova-compute[72992]: DEBUG nova.network.neutron [req-b183b46a-8160-40d5-a120-64051e5af42d req-b3dde5e7-28ca-46aa-84fd-8e8f50efebea service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-b183b46a-8160-40d5-a120-64051e5af42d req-b3dde5e7-28ca-46aa-84fd-8e8f50efebea service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Detach interface failed, port_id=a0331ed5-5162-4b9a-bb4e-9f28a4657d6c, reason: Instance a6e7c604-49e8-47af-a81f-2da89401ea96 could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:30:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:35 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:30:35 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:30:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.812s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:35 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Deleted allocations for instance a6e7c604-49e8-47af-a81f-2da89401ea96
Aug 15 21:30:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-5e31c753-6502-4fa8-a6fc-ec3fc4e28801 req-8f823cda-6ad4-4896-80b3-44e595237f47 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5e31c753-6502-4fa8-a6fc-ec3fc4e28801 req-8f823cda-6ad4-4896-80b3-44e595237f47 service nova] Acquiring lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5e31c753-6502-4fa8-a6fc-ec3fc4e28801 req-8f823cda-6ad4-4896-80b3-44e595237f47 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5e31c753-6502-4fa8-a6fc-ec3fc4e28801 req-8f823cda-6ad4-4896-80b3-44e595237f47 service nova] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-5e31c753-6502-4fa8-a6fc-ec3fc4e28801 req-8f823cda-6ad4-4896-80b3-44e595237f47 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] No waiting events found dispatching network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:35 user nova-compute[72992]: WARNING nova.compute.manager [req-5e31c753-6502-4fa8-a6fc-ec3fc4e28801 req-8f823cda-6ad4-4896-80b3-44e595237f47 service nova] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Received unexpected event network-vif-plugged-a0331ed5-5162-4b9a-bb4e-9f28a4657d6c for instance with vm_state deleted and task_state None.
Aug 15 21:30:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5d063d44-ac95-4ed8-bcda-c9e0b3b51246 tempest-ServerRescueNegativeTestJSON-600517153 tempest-ServerRescueNegativeTestJSON-600517153-project-member] Lock "a6e7c604-49e8-47af-a81f-2da89401ea96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:38 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135022.6959875, e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:30:38 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] VM Stopped (Lifecycle Event)
Aug 15 21:30:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-31e643f9-8529-4a12-a720-439e6abb329b None None] [instance: e43c0ee4-80cc-42c3-9fc6-dc9f759b2bb9] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:30:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:38 user nova-compute[72992]: INFO nova.compute.manager [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Detaching volume 8e710723-04b8-4f78-b5f0-701d0584c025
Aug 15 21:30:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:38 user nova-compute[72992]: INFO nova.virt.block_device [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attempting to driver detach volume 8e710723-04b8-4f78-b5f0-701d0584c025 from mountpoint /dev/vdb
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Attempting to detach device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:30:39 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:30:39 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:30:39 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:30:39 user nova-compute[72992]:   <serial>8e710723-04b8-4f78-b5f0-701d0584c025</serial>
Aug 15 21:30:39 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:30:39 user nova-compute[72992]: </disk>
Aug 15 21:30:39 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:30:39 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config.
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:30:39 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:30:39 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:30:39 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:30:39 user nova-compute[72992]:   <serial>8e710723-04b8-4f78-b5f0-701d0584c025</serial>
Aug 15 21:30:39 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:30:39 user nova-compute[72992]: </disk>
Aug 15 21:30:39 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135039.488407, d3234f5a-b582-45eb-9d1d-605b9c7c0e21 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:30:39 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config.
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rHLtfkVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:30:39 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[83756b07-44f1-4bc8-b6f9-3f5ce8dea161]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed491bf6-59ff-429d-9abc-e4cd033bb192]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:39 user nova-compute[72992]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)
Aug 15 21:30:39 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:39 user nova-compute[72992]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 (non-flash)
Aug 15 21:30:39 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64b50820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1ff5bd-17b2-4d72-84a9-0a1191c2f059]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c49c21-2c8b-4685-b7ad-aeee79103542]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c03488-f518-4ba4-b7fb-9331b191c15f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dfcc71-32af-494a-bf61-f13cef79549b]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c7de34-4983-43b9-8358-e0b91aaf53b3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba0a3f-74f4-4d3a-8f5f-eb71bee87adc]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260]
Aug 15 21:30:39 user nova-compute[72992]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025, portal: 172.16.0.220,3260] successful.
Aug 15 21:30:39 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e710723-04b8-4f78-b5f0-701d0584c025 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba239e-10fa-4ee0-9c8e-f124843d501a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== disconnect_volume: return (291ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:30:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:30:40 user nova-compute[72992]: DEBUG nova.objects.instance [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-700cdc6d-9010-40ab-a142-c8eed657ae36 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.796s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:41 user nova-compute[72992]: INFO nova.compute.manager [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Terminating instance
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-2809823b-07c2-4efb-a460-28e758da9fdf req-4e5a35df-81a9-466c-b242-2a7fd93b5a50 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received event network-vif-unplugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2809823b-07c2-4efb-a460-28e758da9fdf req-4e5a35df-81a9-466c-b242-2a7fd93b5a50 service nova] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2809823b-07c2-4efb-a460-28e758da9fdf req-4e5a35df-81a9-466c-b242-2a7fd93b5a50 service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2809823b-07c2-4efb-a460-28e758da9fdf req-4e5a35df-81a9-466c-b242-2a7fd93b5a50 service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-2809823b-07c2-4efb-a460-28e758da9fdf req-4e5a35df-81a9-466c-b242-2a7fd93b5a50 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] No waiting events found dispatching network-vif-unplugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-2809823b-07c2-4efb-a460-28e758da9fdf req-4e5a35df-81a9-466c-b242-2a7fd93b5a50 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received event network-vif-unplugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Instance destroyed successfully.
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lazy-loading 'resources' on Instance uuid 0e1af659-08bc-4097-bcb3-12c14816d6ee {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-131090758',display_name='tempest-ServersNegativeTestJSON-server-131090758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-131090758',id=22,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:21:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='012f4eadf36d411ab5f9f38ae8910e33',ramdisk_id='',reservation_id='r-jwh0g1e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-827890923',owner_user_name='tempest-ServersNegativeTestJSON-827890923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:21:53Z,user_data=None,user_id='7d9bab564e134919a835eb6c932e3c7b',uuid=0e1af659-08bc-4097-bcb3-12c14816d6ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converting VIF {"id": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "address": "fa:16:3e:e5:11:d2", "network": {"id": "32e69a80-9fd6-441c-85eb-fe1e0da7bafa", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1919979519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "012f4eadf36d411ab5f9f38ae8910e33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda94ab1c-c4", "ovs_interfaceid": "da94ab1c-c497-4d2e-bd6d-3030b5d905e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:11:d2,bridge_name='br-int',has_traffic_filtering=True,id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda94ab1c-c4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG os_vif [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:11:d2,bridge_name='br-int',has_traffic_filtering=True,id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda94ab1c-c4') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda94ab1c-c4, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:41 user nova-compute[72992]: INFO os_vif [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:11:d2,bridge_name='br-int',has_traffic_filtering=True,id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8,network=Network(32e69a80-9fd6-441c-85eb-fe1e0da7bafa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda94ab1c-c4')
Aug 15 21:30:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Deleting instance files /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee_del
Aug 15 21:30:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Deletion of /opt/stack/data/nova/instances/0e1af659-08bc-4097-bcb3-12c14816d6ee_del complete
Aug 15 21:30:42 user nova-compute[72992]: INFO nova.compute.manager [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 15 21:30:42 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:42 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Took 0.59 seconds to deallocate network for instance.
Aug 15 21:30:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-fff320db-071f-45b3-8c99-c10a209d1920 req-c1023a58-cb37-4aa4-9a84-bc2ae5aa93fe service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received event network-vif-deleted-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:42 user nova-compute[72992]: INFO nova.compute.manager [req-fff320db-071f-45b3-8c99-c10a209d1920 req-c1023a58-cb37-4aa4-9a84-bc2ae5aa93fe service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Neutron deleted interface da94ab1c-c497-4d2e-bd6d-3030b5d905e8; detaching it from the instance and deleting it from the info cache
Aug 15 21:30:42 user nova-compute[72992]: DEBUG nova.network.neutron [req-fff320db-071f-45b3-8c99-c10a209d1920 req-c1023a58-cb37-4aa4-9a84-bc2ae5aa93fe service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-fff320db-071f-45b3-8c99-c10a209d1920 req-c1023a58-cb37-4aa4-9a84-bc2ae5aa93fe service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Detach interface failed, port_id=da94ab1c-c497-4d2e-bd6d-3030b5d905e8, reason: Instance 0e1af659-08bc-4097-bcb3-12c14816d6ee could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:42 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:30:43 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:30:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:43 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Deleted allocations for instance 0e1af659-08bc-4097-bcb3-12c14816d6ee
Aug 15 21:30:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2265b96-dfbb-4a2b-b49a-9eff56301c6e tempest-ServersNegativeTestJSON-827890923 tempest-ServersNegativeTestJSON-827890923-project-member] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-b3dc756d-26a4-484d-bb3c-938ad1a5968a req-c408a6c7-6a28-4b7e-8f24-ac8ffec13508 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received event network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b3dc756d-26a4-484d-bb3c-938ad1a5968a req-c408a6c7-6a28-4b7e-8f24-ac8ffec13508 service nova] Acquiring lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b3dc756d-26a4-484d-bb3c-938ad1a5968a req-c408a6c7-6a28-4b7e-8f24-ac8ffec13508 service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b3dc756d-26a4-484d-bb3c-938ad1a5968a req-c408a6c7-6a28-4b7e-8f24-ac8ffec13508 service nova] Lock "0e1af659-08bc-4097-bcb3-12c14816d6ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-b3dc756d-26a4-484d-bb3c-938ad1a5968a req-c408a6c7-6a28-4b7e-8f24-ac8ffec13508 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] No waiting events found dispatching network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:43 user nova-compute[72992]: WARNING nova.compute.manager [req-b3dc756d-26a4-484d-bb3c-938ad1a5968a req-c408a6c7-6a28-4b7e-8f24-ac8ffec13508 service nova] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Received unexpected event network-vif-plugged-da94ab1c-c497-4d2e-bd6d-3030b5d905e8 for instance with vm_state deleted and task_state None.
Aug 15 21:30:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:48 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135033.9141655, a6e7c604-49e8-47af-a81f-2da89401ea96 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:30:48 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] VM Stopped (Lifecycle Event)
Aug 15 21:30:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d341c924-1c4b-447a-bd60-9460d0958532 None None] [instance: a6e7c604-49e8-47af-a81f-2da89401ea96] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'flavor' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:49 user nova-compute[72992]: INFO nova.compute.manager [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Attaching volume 435dad0e-5677-496a-b9fb-e8f9c6e8ae16 to /dev/vdb
Aug 15 21:30:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ccaeea-c6db-4716-85b4-89cdb489391b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5b9e16-7e1e-447c-b3b6-38af65c40fb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99b117b-aba6-49a8-86ff-3dc06dcbaf01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b954e-dab4-4a89-8fac-37cc8804726f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:30:50 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9bcd2-ec1d-4162-ae38-12e3fc46438c]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG os_brick.utils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating existing volume attachment record: 3724a391-acc7-49a4-9bdd-c0cf22db2272 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:30:50 user nova-compute[72992]: INFO nova.compute.claims [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Claim successful on node user
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:30:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.policy [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '426fd37dacd64b46b9f8e5d93f052265', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9937b37364574383bb2bee6622aa04c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:30:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Creating image(s)
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:51 user nova-compute[72992]: INFO nova.compute.manager [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Terminating instance
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk 1073741824" returned: 0 in 0.055s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-879b1a9b-10b2-47af-8028-2088a9cd5235 req-b3aa3786-fd72-41f1-a33c-e245041ab011 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-unplugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-879b1a9b-10b2-47af-8028-2088a9cd5235 req-b3aa3786-fd72-41f1-a33c-e245041ab011 service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-879b1a9b-10b2-47af-8028-2088a9cd5235 req-b3aa3786-fd72-41f1-a33c-e245041ab011 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-879b1a9b-10b2-47af-8028-2088a9cd5235 req-b3aa3786-fd72-41f1-a33c-e245041ab011 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-879b1a9b-10b2-47af-8028-2088a9cd5235 req-b3aa3786-fd72-41f1-a33c-e245041ab011 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-unplugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-879b1a9b-10b2-47af-8028-2088a9cd5235 req-b3aa3786-fd72-41f1-a33c-e245041ab011 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-unplugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Successfully created port: 261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Cannot resize image /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'migration_context' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Ensure instance console log exists: /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:51 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Instance destroyed successfully.
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'resources' on Instance uuid aa27d011-e6f9-4a7c-9d06-6633aa933094 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-163271747',display_name='tempest-ServerActionsTestOtherA-server-1865206479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-163271747',id=32,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHb7bXwqMZIeNK/UPVfgL9RBymsbyZftqvthPDwEQWg/QwX2g2qv9Afjk892Qem4fCOitU+U1TDUSyRlNpSysiMh7xI3FONPSgI7IEFlYLIBEMi/wIfR0wMz+VOL+ZMfgg==',key_name='tempest-keypair-2092967577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:27:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-50bw7bpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:27:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=aa27d011-e6f9-4a7c-9d06-6633aa933094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "address": "fa:16:3e:f6:1d:55", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fa2e308-85", "ovs_interfaceid": "4fa2e308-85c4-436b-b95f-1a795bf5d172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG os_vif [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fa2e308-85, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:30:52 user nova-compute[72992]: INFO os_vif [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:1d:55,bridge_name='br-int',has_traffic_filtering=True,id=4fa2e308-85c4-436b-b95f-1a795bf5d172,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fa2e308-85')
Aug 15 21:30:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Deleting instance files /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094_del
Aug 15 21:30:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Deletion of /opt/stack/data/nova/instances/aa27d011-e6f9-4a7c-9d06-6633aa933094_del complete
Aug 15 21:30:52 user nova-compute[72992]: INFO nova.compute.manager [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 21:30:52 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:30:52 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:30:52 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Successfully updated port: 261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquired lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing instance network info cache due to event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] Acquiring lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:53 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Took 1.71 seconds to deallocate network for instance.
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Releasing lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance network_info: |[{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] Acquired lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.neutron [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Start _get_guest_xml network_info=[{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:30:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:30:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-22bcc685-7b1b-4b23-9686-84e8dc95987b req-f52445be-5806-4683-b242-e397bef07121 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-22bcc685-7b1b-4b23-9686-84e8dc95987b req-f52445be-5806-4683-b242-e397bef07121 service nova] Acquiring lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-22bcc685-7b1b-4b23-9686-84e8dc95987b req-f52445be-5806-4683-b242-e397bef07121 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-22bcc685-7b1b-4b23-9686-84e8dc95987b req-f52445be-5806-4683-b242-e397bef07121 service nova] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-22bcc685-7b1b-4b23-9686-84e8dc95987b req-f52445be-5806-4683-b242-e397bef07121 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] No waiting events found dispatching network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:53 user nova-compute[72992]: WARNING nova.compute.manager [req-22bcc685-7b1b-4b23-9686-84e8dc95987b req-f52445be-5806-4683-b242-e397bef07121 service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received unexpected event network-vif-plugged-4fa2e308-85c4-436b-b95f-1a795bf5d172 for instance with vm_state deleted and task_state None.
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742986768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742986768',id=37,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCcr6lgBgR97iT2ThwzGJDpTuYJMbWx8hK/iQ+C9IDaA7rPPMVoOhnjETOSWt3k+kMgbWp0oANgIavO6u/iwlVLxGEnXZIZRD9/QQXyvAVftzfj9CEfkRBoxnLlfqzFQ==',key_name='tempest-keypair-1083363969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-h8amg216',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=fcef2646-8b98-472e-96c0-382a6651336e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'pci_devices' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:30:53 user nova-compute[72992]:   <uuid>fcef2646-8b98-472e-96c0-382a6651336e</uuid>
Aug 15 21:30:53 user nova-compute[72992]:   <name>instance-00000025</name>
Aug 15 21:30:53 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:30:53 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:30:53 user nova-compute[72992]:   <metadata>
Aug 15 21:30:53 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:30:53 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:30:53 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-742986768</nova:name>
Aug 15 21:30:53 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:30:53</nova:creationTime>
Aug 15 21:30:53 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:30:53 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:30:53 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:30:53 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:30:53 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:30:53 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:30:53 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:30:53 user nova-compute[72992]:       <nova:owner>
Aug 15 21:30:53 user nova-compute[72992]:         <nova:user uuid="426fd37dacd64b46b9f8e5d93f052265">tempest-AttachVolumeShelveTestJSON-1272311701-project-member</nova:user>
Aug 15 21:30:53 user nova-compute[72992]:         <nova:project uuid="9937b37364574383bb2bee6622aa04c2">tempest-AttachVolumeShelveTestJSON-1272311701</nova:project>
Aug 15 21:30:53 user nova-compute[72992]:       </nova:owner>
Aug 15 21:30:53 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:30:53 user nova-compute[72992]:       <nova:ports>
Aug 15 21:30:53 user nova-compute[72992]:         <nova:port uuid="261cf3d1-ca1a-4f41-8941-05807eced0fc">
Aug 15 21:30:53 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:30:53 user nova-compute[72992]:         </nova:port>
Aug 15 21:30:53 user nova-compute[72992]:       </nova:ports>
Aug 15 21:30:53 user nova-compute[72992]:     </nova:instance>
Aug 15 21:30:53 user nova-compute[72992]:   </metadata>
Aug 15 21:30:53 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:30:53 user nova-compute[72992]:     <system>
Aug 15 21:30:53 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:30:53 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:30:53 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:30:53 user nova-compute[72992]:       <entry name="serial">fcef2646-8b98-472e-96c0-382a6651336e</entry>
Aug 15 21:30:53 user nova-compute[72992]:       <entry name="uuid">fcef2646-8b98-472e-96c0-382a6651336e</entry>
Aug 15 21:30:53 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:30:53 user nova-compute[72992]:     </system>
Aug 15 21:30:53 user nova-compute[72992]:   </sysinfo>
Aug 15 21:30:53 user nova-compute[72992]:   <os>
Aug 15 21:30:53 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:30:53 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:30:53 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:30:53 user nova-compute[72992]:   </os>
Aug 15 21:30:53 user nova-compute[72992]:   <features>
Aug 15 21:30:53 user nova-compute[72992]:     <acpi/>
Aug 15 21:30:53 user nova-compute[72992]:     <apic/>
Aug 15 21:30:53 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:30:53 user nova-compute[72992]:   </features>
Aug 15 21:30:53 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:30:53 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:30:53 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:30:53 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:30:53 user nova-compute[72992]:   </clock>
Aug 15 21:30:53 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:30:53 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:30:53 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:30:53 user nova-compute[72992]:   </cpu>
Aug 15 21:30:53 user nova-compute[72992]:   <devices>
Aug 15 21:30:53 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:30:53 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:30:53 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk"/>
Aug 15 21:30:53 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:30:53 user nova-compute[72992]:     </disk>
Aug 15 21:30:53 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:30:53 user nova-compute[72992]:       <mac address="fa:16:3e:da:b4:56"/>
Aug 15 21:30:53 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:30:53 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:30:53 user nova-compute[72992]:       <target dev="tap261cf3d1-ca"/>
Aug 15 21:30:53 user nova-compute[72992]:     </interface>
Aug 15 21:30:53 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:30:53 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/console.log" append="off"/>
Aug 15 21:30:53 user nova-compute[72992]:     </serial>
Aug 15 21:30:53 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:30:53 user nova-compute[72992]:     <video>
Aug 15 21:30:53 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:30:53 user nova-compute[72992]:     </video>
Aug 15 21:30:53 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:30:53 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:30:53 user nova-compute[72992]:     </rng>
Aug 15 21:30:53 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:30:53 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:30:53 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:30:53 user nova-compute[72992]:     </memballoon>
Aug 15 21:30:53 user nova-compute[72992]:   </devices>
Aug 15 21:30:53 user nova-compute[72992]: </domain>
Aug 15 21:30:53 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742986768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742986768',id=37,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCcr6lgBgR97iT2ThwzGJDpTuYJMbWx8hK/iQ+C9IDaA7rPPMVoOhnjETOSWt3k+kMgbWp0oANgIavO6u/iwlVLxGEnXZIZRD9/QQXyvAVftzfj9CEfkRBoxnLlfqzFQ==',key_name='tempest-keypair-1083363969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-h8amg216',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=fcef2646-8b98-472e-96c0-382a6651336e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG os_vif [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap261cf3d1-ca, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap261cf3d1-ca, col_values=(('external_ids', {'iface-id': '261cf3d1-ca1a-4f41-8941-05807eced0fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:b4:56', 'vm-uuid': 'fcef2646-8b98-472e-96c0-382a6651336e'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:30:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:53 user nova-compute[72992]: INFO os_vif [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca')
Aug 15 21:30:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:30:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No VIF found with MAC fa:16:3e:da:b4:56, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:30:54 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:30:54 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:30:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:54 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Deleted allocations for instance aa27d011-e6f9-4a7c-9d06-6633aa933094
Aug 15 21:30:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updated VIF entry in instance network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:30:54 user nova-compute[72992]: DEBUG nova.network.neutron [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:30:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-456ff993-23e5-4909-89d6-ff5f7ffd1bee req-68fa7f97-25fa-419a-b09e-f666e9e33c82 service nova] Releasing lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:30:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2fef369-6c82-4845-832b-5bdf37158f2c tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "aa27d011-e6f9-4a7c-9d06-6633aa933094" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.240s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-2e1a5275-543c-466f-8e5e-6acb8ea6cf8a req-2ed0eda3-b945-4c99-9293-78303a2acf9e service nova] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Received event network-vif-deleted-4fa2e308-85c4-436b-b95f-1a795bf5d172 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:56 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135041.9258058, 0e1af659-08bc-4097-bcb3-12c14816d6ee => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:30:56 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] VM Stopped (Lifecycle Event)
Aug 15 21:30:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-67667121-21a8-43b0-9e62-1a2e56a82ede None None] [instance: 0e1af659-08bc-4097-bcb3-12c14816d6ee] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:57 user nova-compute[72992]: WARNING nova.compute.manager [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received unexpected event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with vm_state building and task_state spawning.
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:30:57 user nova-compute[72992]: WARNING nova.compute.manager [req-3ff2e548-8089-40bb-be8a-25121ca68af1 req-76f820f8-c371-44f8-97c8-779c80dce38e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received unexpected event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with vm_state building and task_state spawning.
Aug 15 21:30:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135057.4674575, fcef2646-8b98-472e-96c0-382a6651336e => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:30:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] VM Resumed (Lifecycle Event)
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:30:57 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance spawned successfully.
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:30:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135057.4702995, fcef2646-8b98-472e-96c0-382a6651336e => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:30:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] VM Started (Lifecycle Event)
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:30:57 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:30:57 user nova-compute[72992]: INFO nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 15 21:30:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:30:57 user nova-compute[72992]: INFO nova.compute.manager [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Took 7.34 seconds to build instance.
Aug 15 21:30:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fd9901c1-85dc-4fb8-a039-8e4c1bb4bd2d tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.440s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:30:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVXCsYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:30:59 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:30:59 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:30:59 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a1ac24-c4b3-4875-9284-1173e21e43a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:30:59 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3238786c-b10c-4a00-a320-43df9fdf1296]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16] added
Aug 15 21:30:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11c875-dcd0-499d-8d9f-1c229a33e283]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b06a84-86fc-4684-a619-68cb60218563]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGVXCsYh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGVXCsYh" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb8ce4a-0441-4e6c-a19a-6b571edfc5f5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGVXCsYh'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b18ed7-4cfe-431c-9724-5c1c929d61a0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe7109-f391-4b20-a64b-a17c3c516f80]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62a097d-d041-4933-81e5-8b07b0414713]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]
Aug 15 21:30:59 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.
Aug 15 21:30:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5d4e6-6081-4a41-99ed-d0ac16841451]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f371877-3507-4f36-8f34-05840162cfea]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:59 user nova-compute[72992]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:30:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:30:59 user nova-compute[72992]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:30:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ddc96e-0fcc-4304-8a4e-bf7655c23d65]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:30:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVXCsYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23065366466376365', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065366466376365', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'flavor' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:31:00 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:31:00 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:31:00 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:31:00 user nova-compute[72992]:   <serial>435dad0e-5677-496a-b9fb-e8f9c6e8ae16</serial>
Aug 15 21:31:00 user nova-compute[72992]: </disk>
Aug 15 21:31:00 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:31:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No VIF found with MAC fa:16:3e:43:a8:5e, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:31:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8e542c99-1687-4909-a2e3-32ea313dd43b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.298s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:06 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135051.957245, aa27d011-e6f9-4a7c-9d06-6633aa933094 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:31:06 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] VM Stopped (Lifecycle Event)
Aug 15 21:31:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e6e6f7c8-5839-41f8-9384-d2dab20ed668 None None] [instance: aa27d011-e6f9-4a7c-9d06-6633aa933094] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:31:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing instance network info cache due to event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] Acquiring lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] Acquired lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updated VIF entry in instance network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:31:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc7712d-02fa-4947-a151-5e1dd8725efe req-1bda4528-cced-4b17-978e-5064b4927a1f service nova] Releasing lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:12 user nova-compute[72992]: INFO nova.compute.manager [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Terminating instance
Aug 15 21:31:12 user nova-compute[72992]: DEBUG nova.compute.manager [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing instance network info cache due to event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] Acquiring lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] Acquired lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.network.neutron [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-vif-unplugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] No waiting events found dispatching network-vif-unplugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-vif-unplugged-a4ca41f5-5a48-451b-906e-b59fb514873e for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] No waiting events found dispatching network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:13 user nova-compute[72992]: WARNING nova.compute.manager [req-2aac323c-a2fd-4ce2-8dc4-01c4ea140446 req-3ee09e34-a53e-4c66-8a59-139ea7f2ff45 service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received unexpected event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e for instance with vm_state active and task_state deleting.
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Instance destroyed successfully.
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.objects.instance [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'resources' on Instance uuid 18dca40c-2589-4fca-97db-5f88e88c7d09 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1275771730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1275771730',id=23,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:21:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-aqwjkush',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:23:47Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=18dca40c-2589-4fca-97db-5f88e88c7d09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "a4ca41f5-5a48-451b-906e-b59fb514873e", "address": "fa:16:3e:0a:70:72", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4ca41f5-5a", "ovs_interfaceid": "a4ca41f5-5a48-451b-906e-b59fb514873e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:70:72,bridge_name='br-int',has_traffic_filtering=True,id=a4ca41f5-5a48-451b-906e-b59fb514873e,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ca41f5-5a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG os_vif [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:70:72,bridge_name='br-int',has_traffic_filtering=True,id=a4ca41f5-5a48-451b-906e-b59fb514873e,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ca41f5-5a') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4ca41f5-5a, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:31:13 user nova-compute[72992]: INFO os_vif [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:70:72,bridge_name='br-int',has_traffic_filtering=True,id=a4ca41f5-5a48-451b-906e-b59fb514873e,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4ca41f5-5a')
Aug 15 21:31:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Deleting instance files /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09_del
Aug 15 21:31:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Deletion of /opt/stack/data/nova/instances/18dca40c-2589-4fca-97db-5f88e88c7d09_del complete
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: INFO nova.compute.manager [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 21:31:13 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updated VIF entry in instance network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG nova.network.neutron [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5965a82d-534f-4629-9f83-adb9b5333e2a req-f4f3bfeb-3046-46b7-a6ab-b2312fa6e65a service nova] Releasing lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:31:14 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Took 0.92 seconds to deallocate network for instance.
Aug 15 21:31:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:31:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:14 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Deleted allocations for instance 18dca40c-2589-4fca-97db-5f88e88c7d09
Aug 15 21:31:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-61eefc21-4c28-4727-b3bb-26f9ba5d69ab tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-26062368-2658-4bdb-a3f4-8f52ba8db98e req-34363a40-26b5-480d-aaee-d6375a030eda service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-26062368-2658-4bdb-a3f4-8f52ba8db98e req-34363a40-26b5-480d-aaee-d6375a030eda service nova] Acquiring lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-26062368-2658-4bdb-a3f4-8f52ba8db98e req-34363a40-26b5-480d-aaee-d6375a030eda service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-26062368-2658-4bdb-a3f4-8f52ba8db98e req-34363a40-26b5-480d-aaee-d6375a030eda service nova] Lock "18dca40c-2589-4fca-97db-5f88e88c7d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-26062368-2658-4bdb-a3f4-8f52ba8db98e req-34363a40-26b5-480d-aaee-d6375a030eda service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] No waiting events found dispatching network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:15 user nova-compute[72992]: WARNING nova.compute.manager [req-26062368-2658-4bdb-a3f4-8f52ba8db98e req-34363a40-26b5-480d-aaee-d6375a030eda service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received unexpected event network-vif-plugged-a4ca41f5-5a48-451b-906e-b59fb514873e for instance with vm_state deleted and task_state None.
Aug 15 21:31:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-26062368-2658-4bdb-a3f4-8f52ba8db98e req-34363a40-26b5-480d-aaee-d6375a030eda service nova] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Received event network-vif-deleted-a4ca41f5-5a48-451b-906e-b59fb514873e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:18 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:19 user nova-compute[72992]: INFO nova.compute.manager [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Rebooting instance
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquired lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:31:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG nova.network.neutron [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Releasing lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-80f3d0ac-1c49-4718-826d-e7d593b65fd2 req-f760eb2e-cc6d-4e74-b066-667c0d6854ef service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-unplugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-80f3d0ac-1c49-4718-826d-e7d593b65fd2 req-f760eb2e-cc6d-4e74-b066-667c0d6854ef service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-80f3d0ac-1c49-4718-826d-e7d593b65fd2 req-f760eb2e-cc6d-4e74-b066-667c0d6854ef service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-80f3d0ac-1c49-4718-826d-e7d593b65fd2 req-f760eb2e-cc6d-4e74-b066-667c0d6854ef service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-80f3d0ac-1c49-4718-826d-e7d593b65fd2 req-f760eb2e-cc6d-4e74-b066-667c0d6854ef service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-unplugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:20 user nova-compute[72992]: WARNING nova.compute.manager [req-80f3d0ac-1c49-4718-826d-e7d593b65fd2 req-f760eb2e-cc6d-4e74-b066-667c0d6854ef service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received unexpected event network-vif-unplugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 21:31:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance destroyed successfully.
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'resources' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-93833120',display_name='tempest-TestMinimumBasicScenario-server-93833120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-93833120',id=35,image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM758e131dMxuNl5wHFcAlusORhJpbVnzGYf1ccWKH3iXrzjiJGIcx3BZglMNH3aP1aKQ+ua6ZbqcU5IcQfuG9/ttMb0Sy7ojyLXTo7plfC/Xw4YAsOnnm+epD4oTxnWHw==',key_name='tempest-TestMinimumBasicScenario-749627438',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:29:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-q03r0rkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:31:20Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=0a3e352a-c299-457f-98f4-b237d37d08e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_vif [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap377e089e-4e, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:31:21 user nova-compute[72992]: INFO os_vif [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e')
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVXCsYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:31:21 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ad494-846e-4d41-9dd8-7b69d7b17aa3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[03915a25-191f-4776-bfac-23d4fd3965a8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:21 user nova-compute[72992]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:21 user nova-compute[72992]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64ee4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd025ec-526e-4690-a569-72a191f2d5cd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[170a3e1d-3237-45c6-a7f2-bd36cf84602f]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1769bfa0-d083-4e2f-9f34-50d7946a8d2f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71aebd8-86b6-4b2a-bcfb-567da01dc7e7]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[48de5767-d025-48cb-905c-1ebbc08639f0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[889e64b6-4f10-445a-a960-13bfe83d3dc3]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]
Aug 15 21:31:21 user nova-compute[72992]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.
Aug 15 21:31:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d63066-3b00-44c9-a300-22327dba30ba]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== disconnect_volume: return (302ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Start _get_guest_xml network_info=[{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=45b8bf5e-667b-4182-9892-7fe510ef5a6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '45b8bf5e-667b-4182-9892-7fe510ef5a6e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVXCsYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0a3e352a-c299-457f-98f4-b237d37d08e2', 'attached_at': '', 'detached_at': '', 'volume_id': '435dad0e-5677-496a-b9fb-e8f9c6e8ae16', 'serial': '435dad0e-5677-496a-b9fb-e8f9c6e8ae16'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '3724a391-acc7-49a4-9bdd-c0cf22db2272', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:31:21 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=45b8bf5e-667b-4182-9892-7fe510ef5a6e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVXCsYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:31:21 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:31:21 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:31:21 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd0e82-2940-4963-a339-2211498e6acc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:31:21 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da05c7-7895-45d7-b070-8df25e4bb1c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16] added
Aug 15 21:31:21 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c6df4f-b69d-42c4-b14b-7f9623f42aec]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:21 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e3c8c6-335c-493f-9c20-345ac914edeb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGVXCsYh {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGVXCsYh" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aad43d-4230-4a6a-bd11-e61e326ef9f0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGVXCsYh'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe701ff0-cb29-4612-ba33-7f555b0a3ff1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8bb06b-c600-49dc-9075-9fd8a68f9ed5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[04db6897-65b3-44e2-9ebb-aa6c0ab746ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]
Aug 15 21:31:22 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.
Aug 15 21:31:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab7400-061b-44bd-9b96-4354b61b005a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b188d5b-0fc2-4d4a-8726-a991f3c65d46]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:22 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:22 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[30082194-d810-46c6-979b-f09dd8376a40]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVXCsYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-58674dc6-a1dd-4334-81b5-e3219e4150f8 req-29704892-e131-45a9-8a37-c6789175d810 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-58674dc6-a1dd-4334-81b5-e3219e4150f8 req-29704892-e131-45a9-8a37-c6789175d810 service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-58674dc6-a1dd-4334-81b5-e3219e4150f8 req-29704892-e131-45a9-8a37-c6789175d810 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-58674dc6-a1dd-4334-81b5-e3219e4150f8 req-29704892-e131-45a9-8a37-c6789175d810 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG nova.compute.manager [req-58674dc6-a1dd-4334-81b5-e3219e4150f8 req-29704892-e131-45a9-8a37-c6789175d810 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:22 user nova-compute[72992]: WARNING nova.compute.manager [req-58674dc6-a1dd-4334-81b5-e3219e4150f8 req-29704892-e131-45a9-8a37-c6789175d810 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received unexpected event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 21:31:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:31:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:31:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=25.300777435302734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 76c6d54f-938e-42a0-84d6-659e38f21bb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0a3e352a-c299-457f-98f4-b237d37d08e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a646f27e-7c66-4b37-aaa0-ddb908524e63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance fcef2646-8b98-472e-96c0-382a6651336e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23065366466376365', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065366466376365', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-93833120',display_name='tempest-TestMinimumBasicScenario-server-93833120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-93833120',id=35,image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM758e131dMxuNl5wHFcAlusORhJpbVnzGYf1ccWKH3iXrzjiJGIcx3BZglMNH3aP1aKQ+ua6ZbqcU5IcQfuG9/ttMb0Sy7ojyLXTo7plfC/Xw4YAsOnnm+epD4oTxnWHw==',key_name='tempest-TestMinimumBasicScenario-749627438',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:29:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-q03r0rkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:31:20Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=0a3e352a-c299-457f-98f4-b237d37d08e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:31:23 user nova-compute[72992]:   <uuid>0a3e352a-c299-457f-98f4-b237d37d08e2</uuid>
Aug 15 21:31:23 user nova-compute[72992]:   <name>instance-00000023</name>
Aug 15 21:31:23 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:31:23 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:31:23 user nova-compute[72992]:   <metadata>
Aug 15 21:31:23 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:31:23 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:31:23 user nova-compute[72992]:       <nova:name>tempest-TestMinimumBasicScenario-server-93833120</nova:name>
Aug 15 21:31:23 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:31:21</nova:creationTime>
Aug 15 21:31:23 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:31:23 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:31:23 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:31:23 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:31:23 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:31:23 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:31:23 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:31:23 user nova-compute[72992]:       <nova:owner>
Aug 15 21:31:23 user nova-compute[72992]:         <nova:user uuid="478df679862f4c3a9887beb0fd2518c7">tempest-TestMinimumBasicScenario-543863856-project-member</nova:user>
Aug 15 21:31:23 user nova-compute[72992]:         <nova:project uuid="626d22c8835e4819aadcf9cbe0180dc1">tempest-TestMinimumBasicScenario-543863856</nova:project>
Aug 15 21:31:23 user nova-compute[72992]:       </nova:owner>
Aug 15 21:31:23 user nova-compute[72992]:       <nova:root type="image" uuid="45b8bf5e-667b-4182-9892-7fe510ef5a6e"/>
Aug 15 21:31:23 user nova-compute[72992]:       <nova:ports>
Aug 15 21:31:23 user nova-compute[72992]:         <nova:port uuid="377e089e-4e71-47ec-ba5c-bcd8f1f5b301">
Aug 15 21:31:23 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:31:23 user nova-compute[72992]:         </nova:port>
Aug 15 21:31:23 user nova-compute[72992]:       </nova:ports>
Aug 15 21:31:23 user nova-compute[72992]:     </nova:instance>
Aug 15 21:31:23 user nova-compute[72992]:   </metadata>
Aug 15 21:31:23 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:31:23 user nova-compute[72992]:     <system>
Aug 15 21:31:23 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:31:23 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:31:23 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:31:23 user nova-compute[72992]:       <entry name="serial">0a3e352a-c299-457f-98f4-b237d37d08e2</entry>
Aug 15 21:31:23 user nova-compute[72992]:       <entry name="uuid">0a3e352a-c299-457f-98f4-b237d37d08e2</entry>
Aug 15 21:31:23 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:31:23 user nova-compute[72992]:     </system>
Aug 15 21:31:23 user nova-compute[72992]:   </sysinfo>
Aug 15 21:31:23 user nova-compute[72992]:   <os>
Aug 15 21:31:23 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:31:23 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:31:23 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:31:23 user nova-compute[72992]:   </os>
Aug 15 21:31:23 user nova-compute[72992]:   <features>
Aug 15 21:31:23 user nova-compute[72992]:     <acpi/>
Aug 15 21:31:23 user nova-compute[72992]:     <apic/>
Aug 15 21:31:23 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:31:23 user nova-compute[72992]:   </features>
Aug 15 21:31:23 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:31:23 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:31:23 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:31:23 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:31:23 user nova-compute[72992]:   </clock>
Aug 15 21:31:23 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:31:23 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:31:23 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:31:23 user nova-compute[72992]:   </cpu>
Aug 15 21:31:23 user nova-compute[72992]:   <devices>
Aug 15 21:31:23 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:31:23 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:31:23 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk"/>
Aug 15 21:31:23 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:31:23 user nova-compute[72992]:     </disk>
Aug 15 21:31:23 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:31:23 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:31:23 user nova-compute[72992]:       <source dev="/dev/sdc"/>
Aug 15 21:31:23 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:31:23 user nova-compute[72992]:       <serial>435dad0e-5677-496a-b9fb-e8f9c6e8ae16</serial>
Aug 15 21:31:23 user nova-compute[72992]:     </disk>
Aug 15 21:31:23 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:31:23 user nova-compute[72992]:       <mac address="fa:16:3e:43:a8:5e"/>
Aug 15 21:31:23 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:31:23 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:31:23 user nova-compute[72992]:       <target dev="tap377e089e-4e"/>
Aug 15 21:31:23 user nova-compute[72992]:     </interface>
Aug 15 21:31:23 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:31:23 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/console.log" append="off"/>
Aug 15 21:31:23 user nova-compute[72992]:     </serial>
Aug 15 21:31:23 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:31:23 user nova-compute[72992]:     <video>
Aug 15 21:31:23 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:31:23 user nova-compute[72992]:     </video>
Aug 15 21:31:23 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:31:23 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:31:23 user nova-compute[72992]:     </rng>
Aug 15 21:31:23 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:31:23 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:31:23 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:31:23 user nova-compute[72992]:     </memballoon>
Aug 15 21:31:23 user nova-compute[72992]:   </devices>
Aug 15 21:31:23 user nova-compute[72992]: </domain>
Aug 15 21:31:23 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:31:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Cannot resize image /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG nova.objects.instance [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'migration_context' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-93833120',display_name='tempest-TestMinimumBasicScenario-server-93833120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-93833120',id=35,image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM758e131dMxuNl5wHFcAlusORhJpbVnzGYf1ccWKH3iXrzjiJGIcx3BZglMNH3aP1aKQ+ua6ZbqcU5IcQfuG9/ttMb0Sy7ojyLXTo7plfC/Xw4YAsOnnm+epD4oTxnWHw==',key_name='tempest-TestMinimumBasicScenario-749627438',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:29:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-q03r0rkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:31:20Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=0a3e352a-c299-457f-98f4-b237d37d08e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG os_vif [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap377e089e-4e, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap377e089e-4e, col_values=(('external_ids', {'iface-id': '377e089e-4e71-47ec-ba5c-bcd8f1f5b301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:a8:5e', 'vm-uuid': '0a3e352a-c299-457f-98f4-b237d37d08e2'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:31:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:24 user nova-compute[72992]: INFO os_vif [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e')
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:25 user nova-compute[72992]: INFO nova.compute.manager [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Terminating instance
Aug 15 21:31:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-f7bcd253-0606-4a79-841d-0254552b0eaa req-7a1bed66-42f8-47fa-bad6-84617016a2b0 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f7bcd253-0606-4a79-841d-0254552b0eaa req-7a1bed66-42f8-47fa-bad6-84617016a2b0 service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f7bcd253-0606-4a79-841d-0254552b0eaa req-7a1bed66-42f8-47fa-bad6-84617016a2b0 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f7bcd253-0606-4a79-841d-0254552b0eaa req-7a1bed66-42f8-47fa-bad6-84617016a2b0 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-f7bcd253-0606-4a79-841d-0254552b0eaa req-7a1bed66-42f8-47fa-bad6-84617016a2b0 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:26 user nova-compute[72992]: WARNING nova.compute.manager [req-f7bcd253-0606-4a79-841d-0254552b0eaa req-7a1bed66-42f8-47fa-bad6-84617016a2b0 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received unexpected event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-7261b89d-d66b-4c8d-816e-3f6e8ffc2f21 req-e2c38056-1322-4172-9892-7066e4a67af2 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-vif-unplugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7261b89d-d66b-4c8d-816e-3f6e8ffc2f21 req-e2c38056-1322-4172-9892-7066e4a67af2 service nova] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7261b89d-d66b-4c8d-816e-3f6e8ffc2f21 req-e2c38056-1322-4172-9892-7066e4a67af2 service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7261b89d-d66b-4c8d-816e-3f6e8ffc2f21 req-e2c38056-1322-4172-9892-7066e4a67af2 service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-7261b89d-d66b-4c8d-816e-3f6e8ffc2f21 req-e2c38056-1322-4172-9892-7066e4a67af2 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] No waiting events found dispatching network-vif-unplugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-7261b89d-d66b-4c8d-816e-3f6e8ffc2f21 req-e2c38056-1322-4172-9892-7066e4a67af2 service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-vif-unplugged-00783325-0df5-494f-abe5-b201ae42062b for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Instance destroyed successfully.
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lazy-loading 'resources' on Instance uuid a646f27e-7c66-4b37-aaa0-ddb908524e63 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:29:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-654216175',display_name='tempest-VolumesActionsTest-instance-654216175',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-654216175',id=36,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a0c51e2c9da4e6ba1f689375f57f21a',ramdisk_id='',reservation_id='r-qdrx8lvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-175706456',owner_user_name='tempest-VolumesActionsTest-175706456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:29:42Z,user_data=None,user_id='0ef12285747c4725a57499fa6efa0e31',uuid=a646f27e-7c66-4b37-aaa0-ddb908524e63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converting VIF {"id": "00783325-0df5-494f-abe5-b201ae42062b", "address": "fa:16:3e:86:5c:f0", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00783325-0d", "ovs_interfaceid": "00783325-0df5-494f-abe5-b201ae42062b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:f0,bridge_name='br-int',has_traffic_filtering=True,id=00783325-0df5-494f-abe5-b201ae42062b,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00783325-0d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG os_vif [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:f0,bridge_name='br-int',has_traffic_filtering=True,id=00783325-0df5-494f-abe5-b201ae42062b,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00783325-0d') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00783325-0d, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:31:26 user nova-compute[72992]: INFO os_vif [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5c:f0,bridge_name='br-int',has_traffic_filtering=True,id=00783325-0df5-494f-abe5-b201ae42062b,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00783325-0d')
Aug 15 21:31:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Deleting instance files /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63_del
Aug 15 21:31:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Deletion of /opt/stack/data/nova/instances/a646f27e-7c66-4b37-aaa0-ddb908524e63_del complete
Aug 15 21:31:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:26 user nova-compute[72992]: INFO nova.compute.manager [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 21:31:26 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:31:26 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for 0a3e352a-c299-457f-98f4-b237d37d08e2 due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135087.5789888, 0a3e352a-c299-457f-98f4-b237d37d08e2 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:31:27 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] VM Resumed (Lifecycle Event)
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:31:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance rebooted successfully.
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:31:27 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135087.5822377, 0a3e352a-c299-457f-98f4-b237d37d08e2 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:31:27 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] VM Started (Lifecycle Event)
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-78f45128-f88d-4b58-b71b-f1b76822c3be tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.085s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-3836e4e7-88ee-4e8a-9e1a-8e91c4c53df5 req-a772844c-fa38-4b27-b7ed-87bae543cc07 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3836e4e7-88ee-4e8a-9e1a-8e91c4c53df5 req-a772844c-fa38-4b27-b7ed-87bae543cc07 service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3836e4e7-88ee-4e8a-9e1a-8e91c4c53df5 req-a772844c-fa38-4b27-b7ed-87bae543cc07 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3836e4e7-88ee-4e8a-9e1a-8e91c4c53df5 req-a772844c-fa38-4b27-b7ed-87bae543cc07 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-3836e4e7-88ee-4e8a-9e1a-8e91c4c53df5 req-a772844c-fa38-4b27-b7ed-87bae543cc07 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:28 user nova-compute[72992]: WARNING nova.compute.manager [req-3836e4e7-88ee-4e8a-9e1a-8e91c4c53df5 req-a772844c-fa38-4b27-b7ed-87bae543cc07 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received unexpected event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with vm_state active and task_state None.
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:31:28 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Took 1.63 seconds to deallocate network for instance.
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] No waiting events found dispatching network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:28 user nova-compute[72992]: WARNING nova.compute.manager [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received unexpected event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b for instance with vm_state active and task_state deleting.
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] Acquiring lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] No waiting events found dispatching network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:31:28 user nova-compute[72992]: WARNING nova.compute.manager [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received unexpected event network-vif-plugged-00783325-0df5-494f-abe5-b201ae42062b for instance with vm_state active and task_state deleting.
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-afabfdd6-bbb2-4cb8-be1e-a827b6b2ca74 req-a5a45184-eef6-418c-a34b-119b72872e6e service nova] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Received event network-vif-deleted-00783325-0df5-494f-abe5-b201ae42062b {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135073.4670548, 18dca40c-2589-4fca-97db-5f88e88c7d09 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:31:28 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] VM Stopped (Lifecycle Event)
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-cd0d031f-b8b0-4b30-a995-2a9d7189608a None None] [instance: 18dca40c-2589-4fca-97db-5f88e88c7d09] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:28 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Deleted allocations for instance a646f27e-7c66-4b37-aaa0-ddb908524e63
Aug 15 21:31:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c34d5bac-de7e-48c7-abfe-cdf87cb95dea tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "a646f27e-7c66-4b37-aaa0-ddb908524e63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:33 user nova-compute[72992]: INFO nova.compute.manager [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attaching volume e49b5c43-7662-41d6-9fa4-9b255ebaa935 to /dev/vdb
Aug 15 21:31:33 user nova-compute[72992]: DEBUG os_brick.utils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c03312-59b9-43ed-97ca-7727fd6bd825]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[98982dd6-fc1c-4a3f-a224-492082648773]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976edd4-80d7-45ce-afde-8dae4ac04eeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec470698-81e5-4b33-bba7-14cb9a72bd74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:31:33 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:31:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[badf479d-d7ec-45aa-9186-6219a265c70b]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG os_brick.utils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:31:33 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating existing volume attachment record: 82f5b942-77ee-4566-b0ed-bfcc03ad5d44 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:31:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:41 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135086.5833445, a646f27e-7c66-4b37-aaa0-ddb908524e63 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:31:41 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] VM Stopped (Lifecycle Event)
Aug 15 21:31:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-7c0dc3a9-c0dc-45c0-9815-c1ea3e6fb9a4 None None] [instance: a646f27e-7c66-4b37-aaa0-ddb908524e63] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:31:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGJiNdgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:31:42 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:31:42 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:31:42 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[beccf084-140a-4418-a8c5-3b7978c2945d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:31:42 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4160e49-8d07-4416-ab02-f7e5f4da9376]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935] added
Aug 15 21:31:42 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69a6e55-6111-4770-8a4f-d37e2d9f4b46]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a31a75a-0129-4a34-aa11-4dcd7b1e6340]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WGJiNdgz {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WGJiNdgz" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3793ba23-0264-4aaa-9fbf-028dea156099]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WGJiNdgz'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3851ae3-e5e1-4490-ac4e-eabc438682d8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[07208cb8-488d-469d-a2b8-83a8dfadbb18]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a745770e-ca0d-40a7-9cf7-a5a59c7dbd51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260]
Aug 15 21:31:43 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260] successful.
Aug 15 21:31:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ee1ef4-dd14-44bd-9352-60ddf312dcc4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cde459-4137-4c17-aed4-43e2251588d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 (non-flash)
Aug 15 21:31:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[297465cb-70a7-4c8a-82c2-35b27b066aa6]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:31:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGJiNdgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23037366433343037', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037366433343037', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:31:44 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:31:44 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:31:44 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:31:44 user nova-compute[72992]:   <serial>e49b5c43-7662-41d6-9fa4-9b255ebaa935</serial>
Aug 15 21:31:44 user nova-compute[72992]: </disk>
Aug 15 21:31:44 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No VIF found with MAC fa:16:3e:75:66:b5, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:31:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6183766b-dc77-4df1-810f-7b2b9e2c06bb tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.618s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:31:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:31:46 user nova-compute[72992]: INFO nova.compute.manager [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Detaching volume e49b5c43-7662-41d6-9fa4-9b255ebaa935
Aug 15 21:31:46 user nova-compute[72992]: INFO nova.virt.block_device [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attempting to driver detach volume e49b5c43-7662-41d6-9fa4-9b255ebaa935 from mountpoint /dev/vdb
Aug 15 21:31:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Attempting to detach device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:31:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:31:46 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:31:46 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:31:46 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:31:46 user nova-compute[72992]:   <serial>e49b5c43-7662-41d6-9fa4-9b255ebaa935</serial>
Aug 15 21:31:46 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:31:46 user nova-compute[72992]: </disk>
Aug 15 21:31:46 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:31:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config.
Aug 15 21:31:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:31:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:31:46 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:31:46 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:31:46 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:31:46 user nova-compute[72992]:   <serial>e49b5c43-7662-41d6-9fa4-9b255ebaa935</serial>
Aug 15 21:31:46 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:31:46 user nova-compute[72992]: </disk>
Aug 15 21:31:46 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135107.4902627, d3234f5a-b582-45eb-9d1d-605b9c7c0e21 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:31:47 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config.
Aug 15 21:31:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WGJiNdgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:31:47 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa05097-6c53-49c7-b27c-b005dd57b962]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ba7fa2-a1d8-4a8e-b977-160a6d36c4cf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:47 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:47 user nova-compute[72992]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 (non-flash)
Aug 15 21:31:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:31:47 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:31:47 user nova-compute[72992]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 (non-flash)
Aug 15 21:31:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64d7d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0eb808-47d3-445d-af79-f5754aa7e4c6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f095f936-6b67-4401-8fa7-5212e01b3731]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1251e2eb-1ae9-4075-a210-8c1d80d7a511]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a51ea1-39e0-403a-a53d-b021101d4be9]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b164817-d486-4b2c-851e-8685b5a55473]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[006f4f23-63c4-4e21-b84e-acf6c80df6bf]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260]
Aug 15 21:31:47 user nova-compute[72992]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935, portal: 172.16.0.220,3260] successful.
Aug 15 21:31:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b5c43-7662-41d6-9fa4-9b255ebaa935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f7f1e9-d3b4-4c98-8fcc-68732ae179e7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== disconnect_volume: return (296ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:31:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:31:48 user nova-compute[72992]: DEBUG nova.objects.instance [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:31:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-199d913b-fa7a-4082-a7ae-c2499e5ccd38 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:31:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:31:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:03 user nova-compute[72992]: INFO nova.compute.manager [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Terminating instance
Aug 15 21:32:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-e680b900-58cd-427d-91d3-03b89e88cd0f req-fca348a2-2824-4c7c-be94-387f545a490b service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e680b900-58cd-427d-91d3-03b89e88cd0f req-fca348a2-2824-4c7c-be94-387f545a490b service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e680b900-58cd-427d-91d3-03b89e88cd0f req-fca348a2-2824-4c7c-be94-387f545a490b service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e680b900-58cd-427d-91d3-03b89e88cd0f req-fca348a2-2824-4c7c-be94-387f545a490b service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-e680b900-58cd-427d-91d3-03b89e88cd0f req-fca348a2-2824-4c7c-be94-387f545a490b service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG nova.compute.manager [req-e680b900-58cd-427d-91d3-03b89e88cd0f req-fca348a2-2824-4c7c-be94-387f545a490b service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-unplugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:03 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Instance destroyed successfully.
Aug 15 21:32:03 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'resources' on Instance uuid 76c6d54f-938e-42a0-84d6-659e38f21bb8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-76923475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-76923475',id=13,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:18:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-oaaa8jg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:20:04Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=76c6d54f-938e-42a0-84d6-659e38f21bb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:32:03 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "address": "fa:16:3e:a7:cd:25", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06857b3-fd", "ovs_interfaceid": "d06857b3-fd39-47f1-b65d-02d8461f4de8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_vif [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd06857b3-fd, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:04 user nova-compute[72992]: INFO os_vif [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:cd:25,bridge_name='br-int',has_traffic_filtering=True,id=d06857b3-fd39-47f1-b65d-02d8461f4de8,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06857b3-fd')
Aug 15 21:32:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aTfIbozS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:32:04 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c4df7f-ba58-4dbd-9057-f9475941c837]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdce581e-7b0d-4139-8b2a-da945134c95f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:32:04 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 (non-flash)
Aug 15 21:32:04 user nova-compute[72992]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64b53f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d073b1c-f629-44a9-96fe-02c98f5a6fdc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a804011-840f-4036-85c9-77b6a8bd2dae]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2744a7b-ebb6-4f40-84ee-0f670fb5d345]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[da36e30c-ebc9-46a6-9791-a0e780926929]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b11bff-99c9-4d21-990a-e75bb8e5f45d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1bb242-e067-40e5-a87f-c70d5c4bb432]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260]
Aug 15 21:32:04 user nova-compute[72992]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43, portal: 172.16.0.220,3260] successful.
Aug 15 21:32:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc8b823a-18b7-45fe-ae25-205baff0ac43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f398a-3f56-4511-b421-d40486384d5a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] <== disconnect_volume: return (293ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:32:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Deleting instance files /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8_del
Aug 15 21:32:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Deletion of /opt/stack/data/nova/instances/76c6d54f-938e-42a0-84d6-659e38f21bb8_del complete
Aug 15 21:32:04 user nova-compute[72992]: INFO nova.compute.manager [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 21:32:04 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:32:04 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:04 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Took 0.59 seconds to deallocate network for instance.
Aug 15 21:32:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-ef642367-81ee-4890-b9e2-b388bfae96c4 req-0bd70d9d-b771-4440-bbdf-dad9465ed33d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ef642367-81ee-4890-b9e2-b388bfae96c4 req-0bd70d9d-b771-4440-bbdf-dad9465ed33d service nova] Acquiring lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ef642367-81ee-4890-b9e2-b388bfae96c4 req-0bd70d9d-b771-4440-bbdf-dad9465ed33d service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ef642367-81ee-4890-b9e2-b388bfae96c4 req-0bd70d9d-b771-4440-bbdf-dad9465ed33d service nova] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-ef642367-81ee-4890-b9e2-b388bfae96c4 req-0bd70d9d-b771-4440-bbdf-dad9465ed33d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] No waiting events found dispatching network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:05 user nova-compute[72992]: WARNING nova.compute.manager [req-ef642367-81ee-4890-b9e2-b388bfae96c4 req-0bd70d9d-b771-4440-bbdf-dad9465ed33d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received unexpected event network-vif-plugged-d06857b3-fd39-47f1-b65d-02d8461f4de8 for instance with vm_state active and task_state deleting.
Aug 15 21:32:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-ef642367-81ee-4890-b9e2-b388bfae96c4 req-0bd70d9d-b771-4440-bbdf-dad9465ed33d service nova] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Received event network-vif-deleted-d06857b3-fd39-47f1-b65d-02d8461f4de8 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:05 user nova-compute[72992]: INFO nova.compute.manager [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 21:32:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:05 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:06 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Deleted allocations for instance 76c6d54f-938e-42a0-84d6-659e38f21bb8
Aug 15 21:32:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c036bb80-ab36-4432-9a27-538fb41c63da tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "76c6d54f-938e-42a0-84d6-659e38f21bb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.938s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:13 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:32:17 user nova-compute[72992]: INFO nova.compute.claims [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Claim successful on node user
Aug 15 21:32:17 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:32:18 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.policy [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ef12285747c4725a57499fa6efa0e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0c51e2c9da4e6ba1f689375f57f21a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:32:18 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Creating image(s)
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "/opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "/opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk 1073741824" returned: 0 in 0.054s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Successfully created port: d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:18 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135123.9723425, 76c6d54f-938e-42a0-84d6-659e38f21bb8 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:32:18 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] VM Stopped (Lifecycle Event)
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-881094da-2a91-4156-9b42-9c66bf1ed23d None None] [instance: 76c6d54f-938e-42a0-84d6-659e38f21bb8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Cannot resize image /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lazy-loading 'migration_context' on Instance uuid f6fc8482-be81-4681-ad26-80af0fd7b3aa {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Ensure instance console log exists: /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Successfully updated port: d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "refresh_cache-f6fc8482-be81-4681-ad26-80af0fd7b3aa" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquired lock "refresh_cache-f6fc8482-be81-4681-ad26-80af0fd7b3aa" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-changed-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Refreshing instance network info cache due to event network-changed-d5992d13-88a8-42c9-9e41-54049b129e75. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] Acquiring lock "refresh_cache-f6fc8482-be81-4681-ad26-80af0fd7b3aa" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Updating instance_info_cache with network_info: [{"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Releasing lock "refresh_cache-f6fc8482-be81-4681-ad26-80af0fd7b3aa" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Instance network_info: |[{"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] Acquired lock "refresh_cache-f6fc8482-be81-4681-ad26-80af0fd7b3aa" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.neutron [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Refreshing network info cache for port d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Start _get_guest_xml network_info=[{"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:32:19 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:19 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1391700360',display_name='tempest-VolumesActionsTest-instance-1391700360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1391700360',id=38,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a0c51e2c9da4e6ba1f689375f57f21a',ramdisk_id='',reservation_id='r-hp5hei3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-175706456',owner_user_name='tempest-VolumesActionsTest-175706456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:18Z,user_data=None,user_id='0ef12285747c4725a57499fa6efa0e31',uuid=f6fc8482-be81-4681-ad26-80af0fd7b3aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converting VIF {"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:37:88,bridge_name='br-int',has_traffic_filtering=True,id=d5992d13-88a8-42c9-9e41-54049b129e75,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5992d13-88') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lazy-loading 'pci_devices' on Instance uuid f6fc8482-be81-4681-ad26-80af0fd7b3aa {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:32:19 user nova-compute[72992]:   <uuid>f6fc8482-be81-4681-ad26-80af0fd7b3aa</uuid>
Aug 15 21:32:19 user nova-compute[72992]:   <name>instance-00000026</name>
Aug 15 21:32:19 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:32:19 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:32:19 user nova-compute[72992]:   <metadata>
Aug 15 21:32:19 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:32:19 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:32:19 user nova-compute[72992]:       <nova:name>tempest-VolumesActionsTest-instance-1391700360</nova:name>
Aug 15 21:32:19 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:32:19</nova:creationTime>
Aug 15 21:32:19 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:32:19 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:32:19 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:32:19 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:32:19 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:32:19 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:32:19 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:32:19 user nova-compute[72992]:       <nova:owner>
Aug 15 21:32:19 user nova-compute[72992]:         <nova:user uuid="0ef12285747c4725a57499fa6efa0e31">tempest-VolumesActionsTest-175706456-project-member</nova:user>
Aug 15 21:32:19 user nova-compute[72992]:         <nova:project uuid="0a0c51e2c9da4e6ba1f689375f57f21a">tempest-VolumesActionsTest-175706456</nova:project>
Aug 15 21:32:19 user nova-compute[72992]:       </nova:owner>
Aug 15 21:32:19 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:32:19 user nova-compute[72992]:       <nova:ports>
Aug 15 21:32:19 user nova-compute[72992]:         <nova:port uuid="d5992d13-88a8-42c9-9e41-54049b129e75">
Aug 15 21:32:19 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 21:32:19 user nova-compute[72992]:         </nova:port>
Aug 15 21:32:19 user nova-compute[72992]:       </nova:ports>
Aug 15 21:32:19 user nova-compute[72992]:     </nova:instance>
Aug 15 21:32:19 user nova-compute[72992]:   </metadata>
Aug 15 21:32:19 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:32:19 user nova-compute[72992]:     <system>
Aug 15 21:32:19 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:32:19 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:32:19 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:32:19 user nova-compute[72992]:       <entry name="serial">f6fc8482-be81-4681-ad26-80af0fd7b3aa</entry>
Aug 15 21:32:19 user nova-compute[72992]:       <entry name="uuid">f6fc8482-be81-4681-ad26-80af0fd7b3aa</entry>
Aug 15 21:32:19 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:32:19 user nova-compute[72992]:     </system>
Aug 15 21:32:19 user nova-compute[72992]:   </sysinfo>
Aug 15 21:32:19 user nova-compute[72992]:   <os>
Aug 15 21:32:19 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:32:19 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:32:19 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:32:19 user nova-compute[72992]:   </os>
Aug 15 21:32:19 user nova-compute[72992]:   <features>
Aug 15 21:32:19 user nova-compute[72992]:     <acpi/>
Aug 15 21:32:19 user nova-compute[72992]:     <apic/>
Aug 15 21:32:19 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:32:19 user nova-compute[72992]:   </features>
Aug 15 21:32:19 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:32:19 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:32:19 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:32:19 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:32:19 user nova-compute[72992]:   </clock>
Aug 15 21:32:19 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:32:19 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:32:19 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:32:19 user nova-compute[72992]:   </cpu>
Aug 15 21:32:19 user nova-compute[72992]:   <devices>
Aug 15 21:32:19 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:32:19 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:32:19 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk"/>
Aug 15 21:32:19 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:32:19 user nova-compute[72992]:     </disk>
Aug 15 21:32:19 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:32:19 user nova-compute[72992]:       <mac address="fa:16:3e:7b:37:88"/>
Aug 15 21:32:19 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:32:19 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:32:19 user nova-compute[72992]:       <target dev="tapd5992d13-88"/>
Aug 15 21:32:19 user nova-compute[72992]:     </interface>
Aug 15 21:32:19 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:32:19 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/console.log" append="off"/>
Aug 15 21:32:19 user nova-compute[72992]:     </serial>
Aug 15 21:32:19 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:32:19 user nova-compute[72992]:     <video>
Aug 15 21:32:19 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:32:19 user nova-compute[72992]:     </video>
Aug 15 21:32:19 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:32:19 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:32:19 user nova-compute[72992]:     </rng>
Aug 15 21:32:19 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:32:19 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:32:19 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:32:19 user nova-compute[72992]:     </memballoon>
Aug 15 21:32:19 user nova-compute[72992]:   </devices>
Aug 15 21:32:19 user nova-compute[72992]: </domain>
Aug 15 21:32:19 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1391700360',display_name='tempest-VolumesActionsTest-instance-1391700360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1391700360',id=38,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a0c51e2c9da4e6ba1f689375f57f21a',ramdisk_id='',reservation_id='r-hp5hei3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-175706456',owner_user_name='tempest-VolumesActionsTest-175706456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:18Z,user_data=None,user_id='0ef12285747c4725a57499fa6efa0e31',uuid=f6fc8482-be81-4681-ad26-80af0fd7b3aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converting VIF {"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:37:88,bridge_name='br-int',has_traffic_filtering=True,id=d5992d13-88a8-42c9-9e41-54049b129e75,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5992d13-88') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG os_vif [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:37:88,bridge_name='br-int',has_traffic_filtering=True,id=d5992d13-88a8-42c9-9e41-54049b129e75,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5992d13-88') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5992d13-88, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5992d13-88, col_values=(('external_ids', {'iface-id': 'd5992d13-88a8-42c9-9e41-54049b129e75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:37:88', 'vm-uuid': 'f6fc8482-be81-4681-ad26-80af0fd7b3aa'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:20 user nova-compute[72992]: INFO os_vif [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:37:88,bridge_name='br-int',has_traffic_filtering=True,id=d5992d13-88a8-42c9-9e41-54049b129e75,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5992d13-88')
Aug 15 21:32:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:32:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] No VIF found with MAC fa:16:3e:7b:37:88, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:32:20 user nova-compute[72992]: DEBUG nova.network.neutron [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Updated VIF entry in instance network info cache for port d5992d13-88a8-42c9-9e41-54049b129e75. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:32:20 user nova-compute[72992]: DEBUG nova.network.neutron [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Updating instance_info_cache with network_info: [{"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-39a76a06-fde6-4f76-9d5b-6051e69a4dfa req-1e41928d-4b21-4c28-95e3-3d1949028499 service nova] Releasing lock "refresh_cache-f6fc8482-be81-4681-ad26-80af0fd7b3aa" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-d9bd49ee-1700-40e9-84f2-43b8db3298f8 req-8b02d054-4c1a-4e1b-b281-7f968017bdc3 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d9bd49ee-1700-40e9-84f2-43b8db3298f8 req-8b02d054-4c1a-4e1b-b281-7f968017bdc3 service nova] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d9bd49ee-1700-40e9-84f2-43b8db3298f8 req-8b02d054-4c1a-4e1b-b281-7f968017bdc3 service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-d9bd49ee-1700-40e9-84f2-43b8db3298f8 req-8b02d054-4c1a-4e1b-b281-7f968017bdc3 service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-d9bd49ee-1700-40e9-84f2-43b8db3298f8 req-8b02d054-4c1a-4e1b-b281-7f968017bdc3 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] No waiting events found dispatching network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:21 user nova-compute[72992]: WARNING nova.compute.manager [req-d9bd49ee-1700-40e9-84f2-43b8db3298f8 req-8b02d054-4c1a-4e1b-b281-7f968017bdc3 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received unexpected event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 for instance with vm_state building and task_state spawning.
Aug 15 21:32:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:21 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:32:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135143.619647, f6fc8482-be81-4681-ad26-80af0fd7b3aa => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:32:23 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] VM Resumed (Lifecycle Event)
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:32:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Instance spawned successfully.
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:23 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135143.625194, f6fc8482-be81-4681-ad26-80af0fd7b3aa => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:32:23 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] VM Started (Lifecycle Event)
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-df3b3899-e551-48b4-ad86-26da7559c76e req-ebeeb9f8-cc77-439d-a2af-163f4c450f18 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-df3b3899-e551-48b4-ad86-26da7559c76e req-ebeeb9f8-cc77-439d-a2af-163f4c450f18 service nova] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-df3b3899-e551-48b4-ad86-26da7559c76e req-ebeeb9f8-cc77-439d-a2af-163f4c450f18 service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-df3b3899-e551-48b4-ad86-26da7559c76e req-ebeeb9f8-cc77-439d-a2af-163f4c450f18 service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-df3b3899-e551-48b4-ad86-26da7559c76e req-ebeeb9f8-cc77-439d-a2af-163f4c450f18 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] No waiting events found dispatching network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:23 user nova-compute[72992]: WARNING nova.compute.manager [req-df3b3899-e551-48b4-ad86-26da7559c76e req-ebeeb9f8-cc77-439d-a2af-163f4c450f18 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received unexpected event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 for instance with vm_state building and task_state spawning.
Aug 15 21:32:23 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:32:23 user nova-compute[72992]: INFO nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 15 21:32:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:23 user nova-compute[72992]: INFO nova.compute.manager [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Took 6.32 seconds to build instance.
Aug 15 21:32:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0335dbb8-d9c6-4b06-a301-8310dbe617ca tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.425s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8020MB free_disk=25.297988891601562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 217026e1-b750-4861-8806-f0d87eaabb45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0a3e352a-c299-457f-98f4-b237d37d08e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance fcef2646-8b98-472e-96c0-382a6651336e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance f6fc8482-be81-4681-ad26-80af0fd7b3aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:32:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:32:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:32:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:32:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:32:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:40 user nova-compute[72992]: DEBUG nova.objects.instance [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:41 user nova-compute[72992]: INFO nova.compute.manager [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attaching volume a233e5b8-1987-400b-9561-6ed59c02cdb7 to /dev/vdb
Aug 15 21:32:41 user nova-compute[72992]: DEBUG os_brick.utils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d02cfe-0d1a-497e-a402-6c276dbfe0f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43142d7-d52b-488e-aa7f-ac9bcde25ce6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[746c85e3-706e-4945-81e1-2edb19d9d21c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2193b4-e547-4b4e-a59c-14457873b968]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:32:41 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:32:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ef4951-db38-476c-9bd5-83ca8c0e95c4]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG os_brick.utils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating existing volume attachment record: fdf2d280-157b-4ef5-899e-bbcc7b84f9fd {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:32:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing instance network info cache due to event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:32:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] Acquiring lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] Acquired lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:42 user nova-compute[72992]: DEBUG nova.network.neutron [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:32:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updated VIF entry in instance network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:32:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7e200def-7704-427c-a4f3-0c0d582c2fda req-b8b2fa79-522b-424b-8e2a-321e3fb0e2c2 service nova] Releasing lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:32:44 user nova-compute[72992]: INFO nova.compute.claims [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Claim successful on node user
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:32:44 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.policy [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69816aed428443df9cd5423ab3924c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50414be7f9af4d2e925fc7c7bba85a61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:32:44 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Creating image(s)
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "/opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "/opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "/opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.249s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk 1073741824" returned: 0 in 0.054s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Cannot resize image /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG nova.objects.instance [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lazy-loading 'migration_context' on Instance uuid 694668f4-1744-4a9c-a6cf-a1e710d0bad5 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Successfully created port: 25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Ensure instance console log exists: /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG nova.network.neutron [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Successfully updated port: 25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "refresh_cache-694668f4-1744-4a9c-a6cf-a1e710d0bad5" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquired lock "refresh_cache-694668f4-1744-4a9c-a6cf-a1e710d0bad5" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG nova.network.neutron [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received event network-changed-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Refreshing instance network info cache due to event network-changed-25b79100-ed86-466a-8538-42c3e1771cf6. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] Acquiring lock "refresh_cache-694668f4-1744-4a9c-a6cf-a1e710d0bad5" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:46 user nova-compute[72992]: DEBUG nova.network.neutron [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Updating instance_info_cache with network_info: [{"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Releasing lock "refresh_cache-694668f4-1744-4a9c-a6cf-a1e710d0bad5" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Instance network_info: |[{"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] Acquired lock "refresh_cache-694668f4-1744-4a9c-a6cf-a1e710d0bad5" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Refreshing network info cache for port 25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Start _get_guest_xml network_info=[{"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:32:47 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:47 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897907848',display_name='tempest-VolumesActionsTest-instance-897907848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897907848',id=39,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50414be7f9af4d2e925fc7c7bba85a61',ramdisk_id='',reservation_id='r-zk5g9t8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1453664454',owner_user_name='tempest-VolumesActionsTest-1453664454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:45Z,user_data=None,user_id='69816aed428443df9cd5423ab3924c9f',uuid=694668f4-1744-4a9c-a6cf-a1e710d0bad5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Converting VIF {"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:cb:72,bridge_name='br-int',has_traffic_filtering=True,id=25b79100-ed86-466a-8538-42c3e1771cf6,network=Network(5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b79100-ed') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.objects.instance [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lazy-loading 'pci_devices' on Instance uuid 694668f4-1744-4a9c-a6cf-a1e710d0bad5 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:32:47 user nova-compute[72992]:   <uuid>694668f4-1744-4a9c-a6cf-a1e710d0bad5</uuid>
Aug 15 21:32:47 user nova-compute[72992]:   <name>instance-00000027</name>
Aug 15 21:32:47 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:32:47 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:32:47 user nova-compute[72992]:   <metadata>
Aug 15 21:32:47 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:32:47 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:32:47 user nova-compute[72992]:       <nova:name>tempest-VolumesActionsTest-instance-897907848</nova:name>
Aug 15 21:32:47 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:32:47</nova:creationTime>
Aug 15 21:32:47 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:32:47 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:32:47 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:32:47 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:32:47 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:32:47 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:32:47 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:32:47 user nova-compute[72992]:       <nova:owner>
Aug 15 21:32:47 user nova-compute[72992]:         <nova:user uuid="69816aed428443df9cd5423ab3924c9f">tempest-VolumesActionsTest-1453664454-project-member</nova:user>
Aug 15 21:32:47 user nova-compute[72992]:         <nova:project uuid="50414be7f9af4d2e925fc7c7bba85a61">tempest-VolumesActionsTest-1453664454</nova:project>
Aug 15 21:32:47 user nova-compute[72992]:       </nova:owner>
Aug 15 21:32:47 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:32:47 user nova-compute[72992]:       <nova:ports>
Aug 15 21:32:47 user nova-compute[72992]:         <nova:port uuid="25b79100-ed86-466a-8538-42c3e1771cf6">
Aug 15 21:32:47 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:32:47 user nova-compute[72992]:         </nova:port>
Aug 15 21:32:47 user nova-compute[72992]:       </nova:ports>
Aug 15 21:32:47 user nova-compute[72992]:     </nova:instance>
Aug 15 21:32:47 user nova-compute[72992]:   </metadata>
Aug 15 21:32:47 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:32:47 user nova-compute[72992]:     <system>
Aug 15 21:32:47 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:32:47 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:32:47 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:32:47 user nova-compute[72992]:       <entry name="serial">694668f4-1744-4a9c-a6cf-a1e710d0bad5</entry>
Aug 15 21:32:47 user nova-compute[72992]:       <entry name="uuid">694668f4-1744-4a9c-a6cf-a1e710d0bad5</entry>
Aug 15 21:32:47 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:32:47 user nova-compute[72992]:     </system>
Aug 15 21:32:47 user nova-compute[72992]:   </sysinfo>
Aug 15 21:32:47 user nova-compute[72992]:   <os>
Aug 15 21:32:47 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:32:47 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:32:47 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:32:47 user nova-compute[72992]:   </os>
Aug 15 21:32:47 user nova-compute[72992]:   <features>
Aug 15 21:32:47 user nova-compute[72992]:     <acpi/>
Aug 15 21:32:47 user nova-compute[72992]:     <apic/>
Aug 15 21:32:47 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:32:47 user nova-compute[72992]:   </features>
Aug 15 21:32:47 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:32:47 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:32:47 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:32:47 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:32:47 user nova-compute[72992]:   </clock>
Aug 15 21:32:47 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:32:47 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:32:47 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:32:47 user nova-compute[72992]:   </cpu>
Aug 15 21:32:47 user nova-compute[72992]:   <devices>
Aug 15 21:32:47 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:32:47 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:32:47 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk"/>
Aug 15 21:32:47 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:32:47 user nova-compute[72992]:     </disk>
Aug 15 21:32:47 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:32:47 user nova-compute[72992]:       <mac address="fa:16:3e:bc:cb:72"/>
Aug 15 21:32:47 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:32:47 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:32:47 user nova-compute[72992]:       <target dev="tap25b79100-ed"/>
Aug 15 21:32:47 user nova-compute[72992]:     </interface>
Aug 15 21:32:47 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:32:47 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/console.log" append="off"/>
Aug 15 21:32:47 user nova-compute[72992]:     </serial>
Aug 15 21:32:47 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:32:47 user nova-compute[72992]:     <video>
Aug 15 21:32:47 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:32:47 user nova-compute[72992]:     </video>
Aug 15 21:32:47 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:32:47 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:32:47 user nova-compute[72992]:     </rng>
Aug 15 21:32:47 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:32:47 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:32:47 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:32:47 user nova-compute[72992]:     </memballoon>
Aug 15 21:32:47 user nova-compute[72992]:   </devices>
Aug 15 21:32:47 user nova-compute[72992]: </domain>
Aug 15 21:32:47 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897907848',display_name='tempest-VolumesActionsTest-instance-897907848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897907848',id=39,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50414be7f9af4d2e925fc7c7bba85a61',ramdisk_id='',reservation_id='r-zk5g9t8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1453664454',owner_user_name='tempest-VolumesActionsTest-1453664454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:45Z,user_data=None,user_id='69816aed428443df9cd5423ab3924c9f',uuid=694668f4-1744-4a9c-a6cf-a1e710d0bad5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Converting VIF {"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:cb:72,bridge_name='br-int',has_traffic_filtering=True,id=25b79100-ed86-466a-8538-42c3e1771cf6,network=Network(5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b79100-ed') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG os_vif [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:cb:72,bridge_name='br-int',has_traffic_filtering=True,id=25b79100-ed86-466a-8538-42c3e1771cf6,network=Network(5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b79100-ed') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25b79100-ed, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25b79100-ed, col_values=(('external_ids', {'iface-id': '25b79100-ed86-466a-8538-42c3e1771cf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:cb:72', 'vm-uuid': '694668f4-1744-4a9c-a6cf-a1e710d0bad5'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:47 user nova-compute[72992]: INFO os_vif [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:cb:72,bridge_name='br-int',has_traffic_filtering=True,id=25b79100-ed86-466a-8538-42c3e1771cf6,network=Network(5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b79100-ed')
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] No VIF found with MAC fa:16:3e:bc:cb:72, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Updated VIF entry in instance network info cache for port 25b79100-ed86-466a-8538-42c3e1771cf6. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Updating instance_info_cache with network_info: [{"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5d9b28c7-6c08-407b-b5e6-7fd29def3878 req-83c305b2-b032-4f95-b734-05a99798b0e9 service nova] Releasing lock "refresh_cache-694668f4-1744-4a9c-a6cf-a1e710d0bad5" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:32:48 user nova-compute[72992]: INFO nova.compute.claims [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Claim successful on node user
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:48 user nova-compute[72992]: INFO nova.compute.manager [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Shelving
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-29e7a308-2188-44bc-b2cf-80d2b0cfeff3 req-190eecdd-f4af-49b7-be24-be2deb973b8e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-unplugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-29e7a308-2188-44bc-b2cf-80d2b0cfeff3 req-190eecdd-f4af-49b7-be24-be2deb973b8e service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-29e7a308-2188-44bc-b2cf-80d2b0cfeff3 req-190eecdd-f4af-49b7-be24-be2deb973b8e service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-29e7a308-2188-44bc-b2cf-80d2b0cfeff3 req-190eecdd-f4af-49b7-be24-be2deb973b8e service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-29e7a308-2188-44bc-b2cf-80d2b0cfeff3 req-190eecdd-f4af-49b7-be24-be2deb973b8e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-unplugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:48 user nova-compute[72992]: WARNING nova.compute.manager [req-29e7a308-2188-44bc-b2cf-80d2b0cfeff3 req-190eecdd-f4af-49b7-be24-be2deb973b8e service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received unexpected event network-vif-unplugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with vm_state active and task_state shelving.
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.policy [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e852f1365e4ac09a88c5c853a1ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905db4444d040d08e517b2c891ba655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:32:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:32:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Creating image(s)
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "/opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "/opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "/opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-985a61ad-8497-46eb-b81e-7a600f3fd3d3 req-dae7b064-87d2-4c28-9f50-60c63e22fe05 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received event network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-985a61ad-8497-46eb-b81e-7a600f3fd3d3 req-dae7b064-87d2-4c28-9f50-60c63e22fe05 service nova] Acquiring lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-985a61ad-8497-46eb-b81e-7a600f3fd3d3 req-dae7b064-87d2-4c28-9f50-60c63e22fe05 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-985a61ad-8497-46eb-b81e-7a600f3fd3d3 req-dae7b064-87d2-4c28-9f50-60c63e22fe05 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-985a61ad-8497-46eb-b81e-7a600f3fd3d3 req-dae7b064-87d2-4c28-9f50-60c63e22fe05 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] No waiting events found dispatching network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:49 user nova-compute[72992]: WARNING nova.compute.manager [req-985a61ad-8497-46eb-b81e-7a600f3fd3d3 req-dae7b064-87d2-4c28-9f50-60c63e22fe05 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received unexpected event network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 for instance with vm_state building and task_state spawning.
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.245s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk 1073741824" returned: 0 in 0.055s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance destroyed successfully.
Aug 15 21:32:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:49 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Beginning cold snapshot process
Aug 15 21:32:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.210s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk /opt/stack/data/nova/instances/snapshots/tmpfi5rid1o/5e3d71bfec9e4a1c856622109fcee607 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.network.neutron [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Successfully created port: 1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Cannot resize image /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'migration_context' on Instance uuid 90b1ad6c-0531-4667-82ec-e8b60ed39f32 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Ensure instance console log exists: /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk /opt/stack/data/nova/instances/snapshots/tmpfi5rid1o/5e3d71bfec9e4a1c856622109fcee607" returned: 0 in 0.847s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:50 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Snapshot extracted, beginning image upload
Aug 15 21:32:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Successfully updated port: 1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquired lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:50 user nova-compute[72992]: WARNING nova.compute.manager [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received unexpected event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 21:32:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-changed-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Refreshing instance network info cache due to event network-changed-1fafb4da-a4b9-4e50-bf53-705bb593946a. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:32:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] Acquiring lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-07053048-d983-4498-a38a-58c573a578b2 req-158bb8f5-9d32-4ed2-bd99-503ea36c9a09 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received event network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-07053048-d983-4498-a38a-58c573a578b2 req-158bb8f5-9d32-4ed2-bd99-503ea36c9a09 service nova] Acquiring lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-07053048-d983-4498-a38a-58c573a578b2 req-158bb8f5-9d32-4ed2-bd99-503ea36c9a09 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-07053048-d983-4498-a38a-58c573a578b2 req-158bb8f5-9d32-4ed2-bd99-503ea36c9a09 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-07053048-d983-4498-a38a-58c573a578b2 req-158bb8f5-9d32-4ed2-bd99-503ea36c9a09 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] No waiting events found dispatching network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:51 user nova-compute[72992]: WARNING nova.compute.manager [req-07053048-d983-4498-a38a-58c573a578b2 req-158bb8f5-9d32-4ed2-bd99-503ea36c9a09 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received unexpected event network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 for instance with vm_state building and task_state spawning.
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.neutron [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updating instance_info_cache with network_info: [{"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Releasing lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Instance network_info: |[{"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] Acquired lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Refreshing network info cache for port 1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Start _get_guest_xml network_info=[{"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:32:51 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:51 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1074417495',display_name='tempest-VolumesSnapshotTestJSON-instance-1074417495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1074417495',id=40,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzefD5Iy54Tcn/k15zEPyf0fWNirTTyySE+GTkWeGe1+ZXByJP+TUr33J4OVYwks6O3706b9FAVfOROUjCG5o32fMfGfE5zRuNLJGoUoFcjUnOuNZZbKfqZmnF98LLwdA==',key_name='tempest-keypair-964395200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f905db4444d040d08e517b2c891ba655',ramdisk_id='',reservation_id='r-2430vfce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815068151',owner_user_name='tempest-VolumesSnapshotTestJSON-815068151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e852f1365e4ac09a88c5c853a1ebd4',uuid=90b1ad6c-0531-4667-82ec-e8b60ed39f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converting VIF {"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:61:22,bridge_name='br-int',has_traffic_filtering=True,id=1fafb4da-a4b9-4e50-bf53-705bb593946a,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fafb4da-a4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'pci_devices' on Instance uuid 90b1ad6c-0531-4667-82ec-e8b60ed39f32 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:32:51 user nova-compute[72992]:   <uuid>90b1ad6c-0531-4667-82ec-e8b60ed39f32</uuid>
Aug 15 21:32:51 user nova-compute[72992]:   <name>instance-00000028</name>
Aug 15 21:32:51 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:32:51 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:32:51 user nova-compute[72992]:   <metadata>
Aug 15 21:32:51 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:32:51 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:32:51 user nova-compute[72992]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1074417495</nova:name>
Aug 15 21:32:51 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:32:51</nova:creationTime>
Aug 15 21:32:51 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:32:51 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:32:51 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:32:51 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:32:51 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:32:51 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:32:51 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:32:51 user nova-compute[72992]:       <nova:owner>
Aug 15 21:32:51 user nova-compute[72992]:         <nova:user uuid="78e852f1365e4ac09a88c5c853a1ebd4">tempest-VolumesSnapshotTestJSON-815068151-project-member</nova:user>
Aug 15 21:32:51 user nova-compute[72992]:         <nova:project uuid="f905db4444d040d08e517b2c891ba655">tempest-VolumesSnapshotTestJSON-815068151</nova:project>
Aug 15 21:32:51 user nova-compute[72992]:       </nova:owner>
Aug 15 21:32:51 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:32:51 user nova-compute[72992]:       <nova:ports>
Aug 15 21:32:51 user nova-compute[72992]:         <nova:port uuid="1fafb4da-a4b9-4e50-bf53-705bb593946a">
Aug 15 21:32:51 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 21:32:51 user nova-compute[72992]:         </nova:port>
Aug 15 21:32:51 user nova-compute[72992]:       </nova:ports>
Aug 15 21:32:51 user nova-compute[72992]:     </nova:instance>
Aug 15 21:32:51 user nova-compute[72992]:   </metadata>
Aug 15 21:32:51 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:32:51 user nova-compute[72992]:     <system>
Aug 15 21:32:51 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:32:51 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:32:51 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:32:51 user nova-compute[72992]:       <entry name="serial">90b1ad6c-0531-4667-82ec-e8b60ed39f32</entry>
Aug 15 21:32:51 user nova-compute[72992]:       <entry name="uuid">90b1ad6c-0531-4667-82ec-e8b60ed39f32</entry>
Aug 15 21:32:51 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:32:51 user nova-compute[72992]:     </system>
Aug 15 21:32:51 user nova-compute[72992]:   </sysinfo>
Aug 15 21:32:51 user nova-compute[72992]:   <os>
Aug 15 21:32:51 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:32:51 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:32:51 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:32:51 user nova-compute[72992]:   </os>
Aug 15 21:32:51 user nova-compute[72992]:   <features>
Aug 15 21:32:51 user nova-compute[72992]:     <acpi/>
Aug 15 21:32:51 user nova-compute[72992]:     <apic/>
Aug 15 21:32:51 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:32:51 user nova-compute[72992]:   </features>
Aug 15 21:32:51 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:32:51 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:32:51 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:32:51 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:32:51 user nova-compute[72992]:   </clock>
Aug 15 21:32:51 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:32:51 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:32:51 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:32:51 user nova-compute[72992]:   </cpu>
Aug 15 21:32:51 user nova-compute[72992]:   <devices>
Aug 15 21:32:51 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:32:51 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:32:51 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk"/>
Aug 15 21:32:51 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:32:51 user nova-compute[72992]:     </disk>
Aug 15 21:32:51 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:32:51 user nova-compute[72992]:       <mac address="fa:16:3e:2b:61:22"/>
Aug 15 21:32:51 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:32:51 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:32:51 user nova-compute[72992]:       <target dev="tap1fafb4da-a4"/>
Aug 15 21:32:51 user nova-compute[72992]:     </interface>
Aug 15 21:32:51 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:32:51 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/console.log" append="off"/>
Aug 15 21:32:51 user nova-compute[72992]:     </serial>
Aug 15 21:32:51 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:32:51 user nova-compute[72992]:     <video>
Aug 15 21:32:51 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:32:51 user nova-compute[72992]:     </video>
Aug 15 21:32:51 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:32:51 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:32:51 user nova-compute[72992]:     </rng>
Aug 15 21:32:51 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:32:51 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:32:51 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:32:51 user nova-compute[72992]:     </memballoon>
Aug 15 21:32:51 user nova-compute[72992]:   </devices>
Aug 15 21:32:51 user nova-compute[72992]: </domain>
Aug 15 21:32:51 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1074417495',display_name='tempest-VolumesSnapshotTestJSON-instance-1074417495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1074417495',id=40,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzefD5Iy54Tcn/k15zEPyf0fWNirTTyySE+GTkWeGe1+ZXByJP+TUr33J4OVYwks6O3706b9FAVfOROUjCG5o32fMfGfE5zRuNLJGoUoFcjUnOuNZZbKfqZmnF98LLwdA==',key_name='tempest-keypair-964395200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f905db4444d040d08e517b2c891ba655',ramdisk_id='',reservation_id='r-2430vfce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815068151',owner_user_name='tempest-VolumesSnapshotTestJSON-815068151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e852f1365e4ac09a88c5c853a1ebd4',uuid=90b1ad6c-0531-4667-82ec-e8b60ed39f32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converting VIF {"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:61:22,bridge_name='br-int',has_traffic_filtering=True,id=1fafb4da-a4b9-4e50-bf53-705bb593946a,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fafb4da-a4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_vif [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:61:22,bridge_name='br-int',has_traffic_filtering=True,id=1fafb4da-a4b9-4e50-bf53-705bb593946a,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fafb4da-a4') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fafb4da-a4, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1fafb4da-a4, col_values=(('external_ids', {'iface-id': '1fafb4da-a4b9-4e50-bf53-705bb593946a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:61:22', 'vm-uuid': '90b1ad6c-0531-4667-82ec-e8b60ed39f32'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:51 user nova-compute[72992]: INFO os_vif [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:61:22,bridge_name='br-int',has_traffic_filtering=True,id=1fafb4da-a4b9-4e50-bf53-705bb593946a,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fafb4da-a4')
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No VIF found with MAC fa:16:3e:2b:61:22, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjiMrCwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:32:51 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:32:51 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:32:51 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135171.684339, 694668f4-1744-4a9c-a6cf-a1e710d0bad5 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:32:51 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] VM Resumed (Lifecycle Event)
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Instance spawned successfully.
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce805d33-4590-4d42-9e3e-2620a3483171]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:32:51 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f05246d-036b-475b-bb15-ff6bb64d727f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7] added
Aug 15 21:32:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updated VIF entry in instance network info cache for port 1fafb4da-a4b9-4e50-bf53-705bb593946a. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updating instance_info_cache with network_info: [{"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[613213b4-59f1-45ef-9470-bcc335a03a66]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135171.6867976, 694668f4-1744-4a9c-a6cf-a1e710d0bad5 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:32:51 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] VM Started (Lifecycle Event)
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2d6d8baa-41bc-4a4b-bad8-afa879f54a98 req-5d56b85f-c1e3-450b-9d5a-ea81ca3ec1f1 service nova] Releasing lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a78d2a-0b21-4087-b5d5-64da1a1262f3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjiMrCwy {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjiMrCwy" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fdbd49-960e-4ed2-b280-011d3c662df6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjiMrCwy'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: INFO nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 15 21:32:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:51 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cecdeec-400f-4a4f-8eb9-d7f278cecc1a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d47ef4-3922-4204-bde2-86a0ceed7297]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: INFO nova.compute.manager [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Took 7.75 seconds to build instance.
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3874e79-fcd8-4a3d-9ff2-d3c2934e6e8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260]
Aug 15 21:32:51 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260] successful.
Aug 15 21:32:51 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-662c1d5c-3bbc-4c83-98d8-f2549f6cb940 tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.854s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f802fed6-d55c-4256-9bd5-1dbe39570817]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:51 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[772b90d5-4d46-4110-90a4-64c628217828]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:52 user nova-compute[72992]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 (non-flash)
Aug 15 21:32:52 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:52 user nova-compute[72992]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 (non-flash)
Aug 15 21:32:52 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0e3630-c444-4f99-88af-d99d9c7f3ddd]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjiMrCwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26664383266376130', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664383266376130', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:32:53 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:32:53 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 21:32:53 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:32:53 user nova-compute[72992]:   <serial>a233e5b8-1987-400b-9561-6ed59c02cdb7</serial>
Aug 15 21:32:53 user nova-compute[72992]: </disk>
Aug 15 21:32:53 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-012d9db0-6a4e-45ae-ac32-caf8b67fd7b3 req-efdd0ecb-4910-4b6f-94bc-0181f9afd052 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-012d9db0-6a4e-45ae-ac32-caf8b67fd7b3 req-efdd0ecb-4910-4b6f-94bc-0181f9afd052 service nova] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-012d9db0-6a4e-45ae-ac32-caf8b67fd7b3 req-efdd0ecb-4910-4b6f-94bc-0181f9afd052 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-012d9db0-6a4e-45ae-ac32-caf8b67fd7b3 req-efdd0ecb-4910-4b6f-94bc-0181f9afd052 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-012d9db0-6a4e-45ae-ac32-caf8b67fd7b3 req-efdd0ecb-4910-4b6f-94bc-0181f9afd052 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] No waiting events found dispatching network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:53 user nova-compute[72992]: WARNING nova.compute.manager [req-012d9db0-6a4e-45ae-ac32-caf8b67fd7b3 req-efdd0ecb-4910-4b6f-94bc-0181f9afd052 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received unexpected event network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a for instance with vm_state building and task_state spawning.
Aug 15 21:32:53 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Snapshot image upload complete
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:53 user nova-compute[72992]: INFO nova.compute.manager [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Shelve offloading
Aug 15 21:32:53 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance destroyed successfully.
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquired lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No VIF found with MAC fa:16:3e:75:66:b5, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-39e0cb6c-1c8c-4f01-850a-cd5f981a31fa tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.611s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "217026e1-b750-4861-8806-f0d87eaabb45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:54 user nova-compute[72992]: INFO nova.compute.manager [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Terminating instance
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Releasing lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:32:54 user nova-compute[72992]: INFO nova.compute.claims [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Claim successful on node user
Aug 15 21:32:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Instance destroyed successfully.
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.objects.instance [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lazy-loading 'resources' on Instance uuid 217026e1-b750-4861-8806-f0d87eaabb45 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:13:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1793995426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1793995426',id=2,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:13:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0d4659b5fec441f894388f4379fb182',ramdisk_id='',reservation_id='r-mras1vm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-47310148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:15:13Z,user_data=None,user_id='96dac56448a242a7817193b06d3ac23f',uuid=217026e1-b750-4861-8806-f0d87eaabb45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converting VIF {"id": "431bd72a-de42-4b87-94b0-243b9b599473", "address": "fa:16:3e:05:f0:1c", "network": {"id": "7d570d4d-7f9c-49d6-8290-1cee0e76ef73", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1198539953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0d4659b5fec441f894388f4379fb182", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap431bd72a-de", "ovs_interfaceid": "431bd72a-de42-4b87-94b0-243b9b599473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:f0:1c,bridge_name='br-int',has_traffic_filtering=True,id=431bd72a-de42-4b87-94b0-243b9b599473,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd72a-de') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG os_vif [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:f0:1c,bridge_name='br-int',has_traffic_filtering=True,id=431bd72a-de42-4b87-94b0-243b9b599473,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd72a-de') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap431bd72a-de, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:54 user nova-compute[72992]: INFO os_vif [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:f0:1c,bridge_name='br-int',has_traffic_filtering=True,id=431bd72a-de42-4b87-94b0-243b9b599473,network=Network(7d570d4d-7f9c-49d6-8290-1cee0e76ef73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap431bd72a-de')
Aug 15 21:32:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Deleting instance files /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45_del
Aug 15 21:32:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Deletion of /opt/stack/data/nova/instances/217026e1-b750-4861-8806-f0d87eaabb45_del complete
Aug 15 21:32:54 user nova-compute[72992]: INFO nova.compute.manager [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 21:32:54 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:32:54 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.virt.block_device [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Booting with volume d51d7980-48d7-4f6d-9da7-07527f156eaf at /dev/vda
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] No waiting events found dispatching network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:55 user nova-compute[72992]: WARNING nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received unexpected event network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a for instance with vm_state building and task_state spawning.
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received event network-vif-unplugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] No waiting events found dispatching network-vif-unplugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received event network-vif-unplugged-431bd72a-de42-4b87-94b0-243b9b599473 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received event network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Acquiring lock "217026e1-b750-4861-8806-f0d87eaabb45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] Lock "217026e1-b750-4861-8806-f0d87eaabb45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] No waiting events found dispatching network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:32:55 user nova-compute[72992]: WARNING nova.compute.manager [req-4ad66610-9467-4996-832e-93e1ea731d39 req-92503cf2-20cc-4f30-a359-8082529acee2 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received unexpected event network-vif-plugged-431bd72a-de42-4b87-94b0-243b9b599473 for instance with vm_state active and task_state deleting.
Aug 15 21:32:55 user nova-compute[72992]: DEBUG os_brick.utils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c223238-bdc4-4624-9c5b-f438a9ad8385]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[409f62d1-6208-407e-a15f-c3a77781d9f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f18d41-0ff8-45f3-be6c-4aafe9f08c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f942663-9c6c-4e34-a9e9-ff193d02f958]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:32:55 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57250b14-5809-4730-87a4-459dd204e08b]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG os_brick.utils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating existing volume attachment record: a39732f9-d2b6-407c-bb31-9066e5aead35 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135175.5389524, 90b1ad6c-0531-4667-82ec-e8b60ed39f32 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] VM Resumed (Lifecycle Event)
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Instance spawned successfully.
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135175.549707, 90b1ad6c-0531-4667-82ec-e8b60ed39f32 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] VM Started (Lifecycle Event)
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.policy [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9192e3fb208c401190105a465161ad70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386bc7deac3d4d57ae29c8461335ca0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing instance network info cache due to event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] Acquiring lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] Acquired lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.network.neutron [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance destroyed successfully.
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.objects.instance [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'resources' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742986768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742986768',id=37,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCcr6lgBgR97iT2ThwzGJDpTuYJMbWx8hK/iQ+C9IDaA7rPPMVoOhnjETOSWt3k+kMgbWp0oANgIavO6u/iwlVLxGEnXZIZRD9/QQXyvAVftzfj9CEfkRBoxnLlfqzFQ==',key_name='tempest-keypair-1083363969',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:30:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-h8amg216',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member',shelved_at='2023-08-15T21:32:53.429349',shelved_host='user',shelved_image_id='4af743a9-0c2f-4cea-a04c-509c3849fe47'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=fcef2646-8b98-472e-96c0-382a6651336e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG os_vif [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap261cf3d1-ca, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:32:55 user nova-compute[72992]: INFO os_vif [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca')
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Deleting instance files /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e_del
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Deletion of /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e_del complete
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.compute.manager [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Took 7.66 seconds to build instance.
Aug 15 21:32:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-32e02b92-f54d-4ccb-8260-477987ea2e03 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.773s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:55 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Deleted allocations for instance fcef2646-8b98-472e-96c0-382a6651336e
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.objects.instance [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'numa_topology' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:56 user nova-compute[72992]: INFO nova.compute.manager [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Detaching volume a233e5b8-1987-400b-9561-6ed59c02cdb7
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:56 user nova-compute[72992]: INFO nova.virt.block_device [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attempting to driver detach volume a233e5b8-1987-400b-9561-6ed59c02cdb7 from mountpoint /dev/vdb
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Attempting to detach device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:32:56 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:32:56 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 21:32:56 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:32:56 user nova-compute[72992]:   <serial>a233e5b8-1987-400b-9561-6ed59c02cdb7</serial>
Aug 15 21:32:56 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:32:56 user nova-compute[72992]: </disk>
Aug 15 21:32:56 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:32:56 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config.
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:32:56 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:32:56 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 21:32:56 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:32:56 user nova-compute[72992]:   <serial>a233e5b8-1987-400b-9561-6ed59c02cdb7</serial>
Aug 15 21:32:56 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:32:56 user nova-compute[72992]: </disk>
Aug 15 21:32:56 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-022fb1e6-273d-46c8-9dce-7ac6b7c878d3 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.023s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135176.9273853, d3234f5a-b582-45eb-9d1d-605b9c7c0e21 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:32:56 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config.
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjiMrCwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:32:56 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:32:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updated VIF entry in instance network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG nova.network.neutron [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d6e24d-222d-49bb-a587-a2a09bf75c92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:56 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Took 2.00 seconds to deallocate network for instance.
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-dd685ab3-62c4-4274-b081-18103ba990d0 req-d84bbac3-3b8c-4d37-85da-234e138be4ba service nova] Releasing lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fea65e4-6679-4c71-acf0-4bbd3e646c67]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:57 user nova-compute[72992]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 (non-flash)
Aug 15 21:32:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:32:57 user nova-compute[72992]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 (non-flash)
Aug 15 21:32:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64b50430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eee8b3d-3813-43e7-a67d-e69ba77b51ed]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabf302e-4f7e-4d36-bab7-31d2e8b71c11]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0d11c4-58cf-43e7-a12e-3561f3de42f8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9966b51-caeb-4949-a018-7ec7cc46701c]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd92c1d-61cc-4e20-92f5-a8fc2b9831f9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b083dd4-25db-4cfe-a3dc-bc534db959bd]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260]
Aug 15 21:32:57 user nova-compute[72992]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7, portal: 172.16.0.220,3260] successful.
Aug 15 21:32:57 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Successfully created port: 13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a233e5b8-1987-400b-9561-6ed59c02cdb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6842e8bb-f05b-454c-be50-d969ee9eed5d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== disconnect_volume: return (331ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:57 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Deleted allocations for instance 217026e1-b750-4861-8806-f0d87eaabb45
Aug 15 21:32:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-5bff015e-e8f2-4ef3-91b6-8c571d6999cd tempest-ServerBootFromVolumeStableRescueTest-47310148 tempest-ServerBootFromVolumeStableRescueTest-47310148-project-member] Lock "217026e1-b750-4861-8806-f0d87eaabb45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.507s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-6df680a6-e432-46ad-94e8-3a2f028a7b53 req-ad351775-1d60-48fe-96e7-cf14c8403796 service nova] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Received event network-vif-deleted-431bd72a-de42-4b87-94b0-243b9b599473 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e2c4bed5-2f5f-4bc1-90c0-1a8c8fcaab5b tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.077s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Successfully updated port: 13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:32:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance network_info: |[{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:32:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-changed-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:32:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Refreshing instance network info cache due to event network-changed-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:32:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:32:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:32:59 user nova-compute[72992]: DEBUG nova.network.neutron [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Refreshing network info cache for port 13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:33:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updated VIF entry in instance network info cache for port 13eb4425-57ab-4c0c-b0dd-f81b789ddc1e. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:33:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:33:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b6904a61-0b74-42c0-badc-8cda803e098e req-93ee2e8f-151b-4173-8ba4-261a623201ed service nova] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:33:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135169.4875786, fcef2646-8b98-472e-96c0-382a6651336e => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:33:04 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] VM Stopped (Lifecycle Event)
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-69deb18a-bc33-4a97-9a7d-b366ee666d97 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:33:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Creating image(s)
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Ensure instance console log exists: /opt/stack/data/nova/instances/754b808e-e692-42b2-9ab0-fc38e221fb2a/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Start _get_guest_xml network_info=[{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '754b808e-e692-42b2-9ab0-fc38e221fb2a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd51d7980-48d7-4f6d-9da7-07527f156eaf', 'serial': 'd51d7980-48d7-4f6d-9da7-07527f156eaf'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'a39732f9-d2b6-407c-bb31-9066e5aead35', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:33:04 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:33:04 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:33:04 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:33:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:33:04 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:33:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:33:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:33:04 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:33:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0bf010-fd3c-4ff4-bb5d-877415cf7971]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:33:05 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8252c9-ff8e-4aa6-8755-aad0c1806a86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf] added
Aug 15 21:33:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c5dedb-fddd-42b1-8814-2fd0e0997539]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[48082fac-9afc-41f0-b43f-1e594e763c11]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRgyYixr {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRgyYixr" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cbdc46-6c53-4366-b57e-6ffc4158100a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRgyYixr'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049d1a9-469b-485a-b402-e2ab92b2c460]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d080dd3-ca25-432a-b92b-105267d12645]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:33:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:33:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0792335c-54d7-401c-af6c-fd4b73c509c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]
Aug 15 21:33:05 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.
Aug 15 21:33:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d37361-60d3-4483-9872-4fb70f7d3d87]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80040d62-19db-4406-8714-eaf0ce6867be]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:33:05 user nova-compute[72992]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:33:05 user nova-compute[72992]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[97048321-9159-46fa-b1b9-16f0245b053a]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:33:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23934383636373336', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934383636373336', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-936163427',display_name='tempest-ServerActionsTestOtherA-server-936163427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-936163427',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-t1d00ezo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=754b808e-e692-42b2-9ab0-fc38e221fb2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'pci_devices' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:33:06 user nova-compute[72992]:   <uuid>754b808e-e692-42b2-9ab0-fc38e221fb2a</uuid>
Aug 15 21:33:06 user nova-compute[72992]:   <name>instance-00000029</name>
Aug 15 21:33:06 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:33:06 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:33:06 user nova-compute[72992]:   <metadata>
Aug 15 21:33:06 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:33:06 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:33:06 user nova-compute[72992]:       <nova:name>tempest-ServerActionsTestOtherA-server-936163427</nova:name>
Aug 15 21:33:06 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:33:04</nova:creationTime>
Aug 15 21:33:06 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:33:06 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:33:06 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:33:06 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:33:06 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:33:06 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:33:06 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:33:06 user nova-compute[72992]:       <nova:owner>
Aug 15 21:33:06 user nova-compute[72992]:         <nova:user uuid="9192e3fb208c401190105a465161ad70">tempest-ServerActionsTestOtherA-752735396-project-member</nova:user>
Aug 15 21:33:06 user nova-compute[72992]:         <nova:project uuid="386bc7deac3d4d57ae29c8461335ca0e">tempest-ServerActionsTestOtherA-752735396</nova:project>
Aug 15 21:33:06 user nova-compute[72992]:       </nova:owner>
Aug 15 21:33:06 user nova-compute[72992]:       <nova:ports>
Aug 15 21:33:06 user nova-compute[72992]:         <nova:port uuid="13eb4425-57ab-4c0c-b0dd-f81b789ddc1e">
Aug 15 21:33:06 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:33:06 user nova-compute[72992]:         </nova:port>
Aug 15 21:33:06 user nova-compute[72992]:       </nova:ports>
Aug 15 21:33:06 user nova-compute[72992]:     </nova:instance>
Aug 15 21:33:06 user nova-compute[72992]:   </metadata>
Aug 15 21:33:06 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:33:06 user nova-compute[72992]:     <system>
Aug 15 21:33:06 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:33:06 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:33:06 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:33:06 user nova-compute[72992]:       <entry name="serial">754b808e-e692-42b2-9ab0-fc38e221fb2a</entry>
Aug 15 21:33:06 user nova-compute[72992]:       <entry name="uuid">754b808e-e692-42b2-9ab0-fc38e221fb2a</entry>
Aug 15 21:33:06 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:33:06 user nova-compute[72992]:     </system>
Aug 15 21:33:06 user nova-compute[72992]:   </sysinfo>
Aug 15 21:33:06 user nova-compute[72992]:   <os>
Aug 15 21:33:06 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:33:06 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:33:06 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:33:06 user nova-compute[72992]:   </os>
Aug 15 21:33:06 user nova-compute[72992]:   <features>
Aug 15 21:33:06 user nova-compute[72992]:     <acpi/>
Aug 15 21:33:06 user nova-compute[72992]:     <apic/>
Aug 15 21:33:06 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:33:06 user nova-compute[72992]:   </features>
Aug 15 21:33:06 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:33:06 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:33:06 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:33:06 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:33:06 user nova-compute[72992]:   </clock>
Aug 15 21:33:06 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:33:06 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:33:06 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:33:06 user nova-compute[72992]:   </cpu>
Aug 15 21:33:06 user nova-compute[72992]:   <devices>
Aug 15 21:33:06 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:33:06 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:33:06 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:33:06 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:33:06 user nova-compute[72992]:       <serial>d51d7980-48d7-4f6d-9da7-07527f156eaf</serial>
Aug 15 21:33:06 user nova-compute[72992]:     </disk>
Aug 15 21:33:06 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:33:06 user nova-compute[72992]:       <mac address="fa:16:3e:34:08:6f"/>
Aug 15 21:33:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:33:06 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:33:06 user nova-compute[72992]:       <target dev="tap13eb4425-57"/>
Aug 15 21:33:06 user nova-compute[72992]:     </interface>
Aug 15 21:33:06 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:33:06 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/754b808e-e692-42b2-9ab0-fc38e221fb2a/console.log" append="off"/>
Aug 15 21:33:06 user nova-compute[72992]:     </serial>
Aug 15 21:33:06 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:33:06 user nova-compute[72992]:     <video>
Aug 15 21:33:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:33:06 user nova-compute[72992]:     </video>
Aug 15 21:33:06 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:33:06 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:33:06 user nova-compute[72992]:     </rng>
Aug 15 21:33:06 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:33:06 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:33:06 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:33:06 user nova-compute[72992]:     </memballoon>
Aug 15 21:33:06 user nova-compute[72992]:   </devices>
Aug 15 21:33:06 user nova-compute[72992]: </domain>
Aug 15 21:33:06 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-936163427',display_name='tempest-ServerActionsTestOtherA-server-936163427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-936163427',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-t1d00ezo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:32:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=754b808e-e692-42b2-9ab0-fc38e221fb2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG os_vif [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13eb4425-57, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13eb4425-57, col_values=(('external_ids', {'iface-id': '13eb4425-57ab-4c0c-b0dd-f81b789ddc1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:08:6f', 'vm-uuid': '754b808e-e692-42b2-9ab0-fc38e221fb2a'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:06 user nova-compute[72992]: INFO os_vif [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57')
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:33:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No VIF found with MAC fa:16:3e:34:08:6f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-76baa642-e4d3-427b-8b72-ff045402f645 req-840e72c8-a76e-43e7-b0c6-e64c6e49c412 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-76baa642-e4d3-427b-8b72-ff045402f645 req-840e72c8-a76e-43e7-b0c6-e64c6e49c412 service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-76baa642-e4d3-427b-8b72-ff045402f645 req-840e72c8-a76e-43e7-b0c6-e64c6e49c412 service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-76baa642-e4d3-427b-8b72-ff045402f645 req-840e72c8-a76e-43e7-b0c6-e64c6e49c412 service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-76baa642-e4d3-427b-8b72-ff045402f645 req-840e72c8-a76e-43e7-b0c6-e64c6e49c412 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:33:07 user nova-compute[72992]: WARNING nova.compute.manager [req-76baa642-e4d3-427b-8b72-ff045402f645 req-840e72c8-a76e-43e7-b0c6-e64c6e49c412 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received unexpected event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with vm_state building and task_state spawning.
Aug 15 21:33:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135189.7695274, 754b808e-e692-42b2-9ab0-fc38e221fb2a => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] VM Resumed (Lifecycle Event)
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance spawned successfully.
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135189.7722175, 754b808e-e692-42b2-9ab0-fc38e221fb2a => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] VM Started (Lifecycle Event)
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135174.84458, 217026e1-b750-4861-8806-f0d87eaabb45 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] VM Stopped (Lifecycle Event)
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-06913e44-ceac-42c8-bb2a-faedef3c7cb0 None None] [instance: 217026e1-b750-4861-8806-f0d87eaabb45] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-c986e123-6f4a-4080-9c3b-880bcad24726 req-b0285e18-4e28-4b22-b8a6-506d87c7cd7f service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c986e123-6f4a-4080-9c3b-880bcad24726 req-b0285e18-4e28-4b22-b8a6-506d87c7cd7f service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c986e123-6f4a-4080-9c3b-880bcad24726 req-b0285e18-4e28-4b22-b8a6-506d87c7cd7f service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c986e123-6f4a-4080-9c3b-880bcad24726 req-b0285e18-4e28-4b22-b8a6-506d87c7cd7f service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-c986e123-6f4a-4080-9c3b-880bcad24726 req-b0285e18-4e28-4b22-b8a6-506d87c7cd7f service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:33:09 user nova-compute[72992]: WARNING nova.compute.manager [req-c986e123-6f4a-4080-9c3b-880bcad24726 req-b0285e18-4e28-4b22-b8a6-506d87c7cd7f service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received unexpected event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with vm_state building and task_state spawning.
Aug 15 21:33:09 user nova-compute[72992]: INFO nova.compute.manager [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Took 15.42 seconds to build instance.
Aug 15 21:33:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1ee9a0a-1207-4753-ac19-955d01a40009 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.522s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:33:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing instance network info cache due to event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:33:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] Acquiring lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:33:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] Acquired lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:33:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG nova.network.neutron [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updated VIF entry in instance network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG nova.network.neutron [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-90173823-5c9f-4e0b-82c2-dc2977797e6f req-9c3164aa-a689-4935-a2f0-18c33a26e702 service nova] Releasing lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing instance network info cache due to event network-changed-377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] Acquiring lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] Acquired lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:33:12 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Refreshing network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:13 user nova-compute[72992]: INFO nova.compute.manager [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Detaching volume 435dad0e-5677-496a-b9fb-e8f9c6e8ae16
Aug 15 21:33:13 user nova-compute[72992]: INFO nova.virt.block_device [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Attempting to driver detach volume 435dad0e-5677-496a-b9fb-e8f9c6e8ae16 from mountpoint /dev/vdb
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Attempting to detach device vdb from instance 0a3e352a-c299-457f-98f4-b237d37d08e2 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:33:13 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:33:13 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:33:13 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:33:13 user nova-compute[72992]:   <serial>435dad0e-5677-496a-b9fb-e8f9c6e8ae16</serial>
Aug 15 21:33:13 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:33:13 user nova-compute[72992]: </disk>
Aug 15 21:33:13 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:33:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully detached device vdb from instance 0a3e352a-c299-457f-98f4-b237d37d08e2 from the persistent domain config.
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a3e352a-c299-457f-98f4-b237d37d08e2 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:33:13 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:33:13 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:33:13 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:33:13 user nova-compute[72992]:   <serial>435dad0e-5677-496a-b9fb-e8f9c6e8ae16</serial>
Aug 15 21:33:13 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 21:33:13 user nova-compute[72992]: </disk>
Aug 15 21:33:13 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updated VIF entry in instance network info cache for port 377e089e-4e71-47ec-ba5c-bcd8f1f5b301. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [{"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0f67798-3627-41d6-9128-69169ef8edd2 req-8070bf2e-380b-421d-97bf-929cd4462041 service nova] Releasing lock "refresh_cache-0a3e352a-c299-457f-98f4-b237d37d08e2" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135193.7826772, 0a3e352a-c299-457f-98f4-b237d37d08e2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:33:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully detached device vdb from instance 0a3e352a-c299-457f-98f4-b237d37d08e2 from the live domain config.
Aug 15 21:33:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVXCsYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:33:13 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bdad8d-2f06-41f4-9cf5-c64a3b9ee656]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925f4fa-ad60-4340-9d58-b4633d241819]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:33:13 user nova-compute[72992]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 (non-flash)
Aug 15 21:33:13 user nova-compute[72992]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:13 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c87e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[052d939b-5480-4166-9eea-36e4a20c5a07]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3926c919-34f5-4daf-be8a-4cee556a2ea2]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c63f77-0db1-410f-aad2-b58613ef1a46]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0871377-e8e4-4f8c-8baf-7139dd661d79]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:33:13 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50deb80-aeac-4349-8a06-fb15759b2fde]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2db157-c834-4619-8dc3-dd8ea7373153]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260]
Aug 15 21:33:14 user nova-compute[72992]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16, portal: 172.16.0.220,3260] successful.
Aug 15 21:33:14 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:435dad0e-5677-496a-b9fb-e8f9c6e8ae16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[20069ac2-33a6-47fe-92cc-875995b46c78]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== disconnect_volume: return (301ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'flavor' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:33:14 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b17b8d3b-0a8a-4204-a614-4ecc50e21af0 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.789s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:33:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:25 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:33:25 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7648MB free_disk=25.30355453491211GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 0a3e352a-c299-457f-98f4-b237d37d08e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance f6fc8482-be81-4681-ad26-80af0fd7b3aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 694668f4-1744-4a9c-a6cf-a1e710d0bad5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 754b808e-e692-42b2-9ab0-fc38e221fb2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:33:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:33:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e0710ccf-1252-4d29-9b9c-65d0102e20c3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:33:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:33:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:33:50 user nova-compute[72992]: INFO nova.compute.manager [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attaching volume d3a8da3c-78f8-4f90-97a1-f0d274a2c498 to /dev/vdb
Aug 15 21:33:50 user nova-compute[72992]: DEBUG os_brick.utils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00311df-f3b2-4649-8bd9-e380d7068a9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fda569-e247-410b-95c7-cc20ce154b46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[828b61e9-fc25-476b-9632-7f6b2127f9cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08859ab-1944-4b7f-ba76-370fbac8916b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:33:50 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:33:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e774ea8f-e623-4a23-9b84-a436192f195a]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG os_brick.utils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:33:50 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating existing volume attachment record: 22a585ae-aad5-4570-89c4-2f1ee38767c7 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:33:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCSkcnIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:33:59 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:33:59 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:33:59 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0749543-a5d3-4b50-a717-2427a731f3a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:33:59 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe42c5bf-1c91-4080-a266-e0493565ca2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498] added
Aug 15 21:33:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c952a170-0781-4d4d-845d-64d71f7872f6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebf6f3e-7215-4c53-921f-391087539367]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCSkcnIY {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PCSkcnIY" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[726089aa-c59c-4189-a5b5-9f1d2ca65404]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PCSkcnIY'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e75cfd0-adf5-4c33-a8b0-c1a3e6d6f9d5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feb2616-75fd-4e66-b120-abd6ac40db0e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca328af-bc2c-4deb-8948-482561850d19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260]
Aug 15 21:33:59 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260] successful.
Aug 15 21:33:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5891996e-0575-4c7c-8163-6b79b035fa15]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d76c7-1769-4fa2-8166-a2f2eeb1b607]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:59 user nova-compute[72992]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 (non-flash)
Aug 15 21:33:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:33:59 user nova-compute[72992]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 (non-flash)
Aug 15 21:33:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d95eec-a9ae-49f8-b280-92a949b56c8e]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:33:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:34:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:34:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCSkcnIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:34:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:34:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23839373931313565', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:34:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839373931313565', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:34:00 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:34:00 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:34:00 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:34:00 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:34:00 user nova-compute[72992]:   <serial>d3a8da3c-78f8-4f90-97a1-f0d274a2c498</serial>
Aug 15 21:34:00 user nova-compute[72992]: </disk>
Aug 15 21:34:00 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] No VIF found with MAC fa:16:3e:75:66:b5, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c52331bd-e7fc-42fa-a352-849a2da986f6 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.661s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:34:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:04 user nova-compute[72992]: INFO nova.compute.manager [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Detaching volume d3a8da3c-78f8-4f90-97a1-f0d274a2c498
Aug 15 21:34:04 user nova-compute[72992]: INFO nova.virt.block_device [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Attempting to driver detach volume d3a8da3c-78f8-4f90-97a1-f0d274a2c498 from mountpoint /dev/vdb
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Attempting to detach device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:34:04 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:34:04 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:34:04 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:34:04 user nova-compute[72992]:   <serial>d3a8da3c-78f8-4f90-97a1-f0d274a2c498</serial>
Aug 15 21:34:04 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:34:04 user nova-compute[72992]: </disk>
Aug 15 21:34:04 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:34:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the persistent domain config.
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:34:04 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:34:04 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:34:04 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:34:04 user nova-compute[72992]:   <serial>d3a8da3c-78f8-4f90-97a1-f0d274a2c498</serial>
Aug 15 21:34:04 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:34:04 user nova-compute[72992]: </disk>
Aug 15 21:34:04 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135244.670249, d3234f5a-b582-45eb-9d1d-605b9c7c0e21 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:34:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully detached device vdb from instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 from the live domain config.
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PCSkcnIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:34:04 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3831542b-0c06-4716-838d-b9ab1ac02540]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c9b4f-6e7a-4433-bfdd-3b0182e4e47d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:04 user nova-compute[72992]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 (non-flash)
Aug 15 21:34:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:04 user nova-compute[72992]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 (non-flash)
Aug 15 21:34:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c88264280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[35748efc-8bcc-490c-ae29-ac910cef1ce8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc734fee-876c-4884-a912-6e8bf58fdfbc]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf0356e-c326-46d2-b164-4ac98ddc2c93]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c011d622-6a71-4ac0-84f4-a33f97a34f9a]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f82d7-d10b-4d98-aed2-aa58830789a9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e0210-1a44-42a1-b7e3-771b4d14d24c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260]
Aug 15 21:34:04 user nova-compute[72992]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498, portal: 172.16.0.220,3260] successful.
Aug 15 21:34:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3a8da3c-78f8-4f90-97a1-f0d274a2c498 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eec5da-b601-4c59-9f29-f9eb5d8193b4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] <== disconnect_volume: return (275ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:34:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:34:05 user nova-compute[72992]: DEBUG nova.objects.instance [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'flavor' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-33e4065c-97b3-4fa8-8dff-b4c2b573217a tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:08 user nova-compute[72992]: INFO nova.compute.manager [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Terminating instance
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-9a0423a1-65dd-4f49-a187-51ba7c33cd5f req-2b469e6e-e97f-4839-9bb9-776b02b75a32 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-unplugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a0423a1-65dd-4f49-a187-51ba7c33cd5f req-2b469e6e-e97f-4839-9bb9-776b02b75a32 service nova] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a0423a1-65dd-4f49-a187-51ba7c33cd5f req-2b469e6e-e97f-4839-9bb9-776b02b75a32 service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a0423a1-65dd-4f49-a187-51ba7c33cd5f req-2b469e6e-e97f-4839-9bb9-776b02b75a32 service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-9a0423a1-65dd-4f49-a187-51ba7c33cd5f req-2b469e6e-e97f-4839-9bb9-776b02b75a32 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] No waiting events found dispatching network-vif-unplugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-9a0423a1-65dd-4f49-a187-51ba7c33cd5f req-2b469e6e-e97f-4839-9bb9-776b02b75a32 service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-unplugged-d5992d13-88a8-42c9-9e41-54049b129e75 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Instance destroyed successfully.
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lazy-loading 'resources' on Instance uuid f6fc8482-be81-4681-ad26-80af0fd7b3aa {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1391700360',display_name='tempest-VolumesActionsTest-instance-1391700360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1391700360',id=38,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:32:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a0c51e2c9da4e6ba1f689375f57f21a',ramdisk_id='',reservation_id='r-hp5hei3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-175706456',owner_user_name='tempest-VolumesActionsTest-175706456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:32:24Z,user_data=None,user_id='0ef12285747c4725a57499fa6efa0e31',uuid=f6fc8482-be81-4681-ad26-80af0fd7b3aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converting VIF {"id": "d5992d13-88a8-42c9-9e41-54049b129e75", "address": "fa:16:3e:7b:37:88", "network": {"id": "656b16e4-0fd3-4940-bcbf-049a7f88a77c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-416018357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a0c51e2c9da4e6ba1f689375f57f21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5992d13-88", "ovs_interfaceid": "d5992d13-88a8-42c9-9e41-54049b129e75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:37:88,bridge_name='br-int',has_traffic_filtering=True,id=d5992d13-88a8-42c9-9e41-54049b129e75,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5992d13-88') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG os_vif [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:37:88,bridge_name='br-int',has_traffic_filtering=True,id=d5992d13-88a8-42c9-9e41-54049b129e75,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5992d13-88') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5992d13-88, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:34:08 user nova-compute[72992]: INFO os_vif [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:37:88,bridge_name='br-int',has_traffic_filtering=True,id=d5992d13-88a8-42c9-9e41-54049b129e75,network=Network(656b16e4-0fd3-4940-bcbf-049a7f88a77c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5992d13-88')
Aug 15 21:34:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Deleting instance files /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa_del
Aug 15 21:34:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Deletion of /opt/stack/data/nova/instances/f6fc8482-be81-4681-ad26-80af0fd7b3aa_del complete
Aug 15 21:34:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:09 user nova-compute[72992]: INFO nova.compute.manager [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 15 21:34:09 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:09 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Took 0.72 seconds to deallocate network for instance.
Aug 15 21:34:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-1cb13416-fa06-4746-8c12-bd84bc254a70 req-eca80c16-a857-4e8c-9808-0d51e016d1fe service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-deleted-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Deleted allocations for instance f6fc8482-be81-4681-ad26-80af0fd7b3aa
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: INFO nova.compute.manager [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Terminating instance
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-7d20b104-a83b-44fa-8580-3b99953d229b tempest-VolumesActionsTest-175706456 tempest-VolumesActionsTest-175706456-project-member] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.050s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] No waiting events found dispatching network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:10 user nova-compute[72992]: WARNING nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received unexpected event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 for instance with vm_state deleted and task_state None.
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] No waiting events found dispatching network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:10 user nova-compute[72992]: WARNING nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received unexpected event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 for instance with vm_state deleted and task_state None.
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] No waiting events found dispatching network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:10 user nova-compute[72992]: WARNING nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received unexpected event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 for instance with vm_state deleted and task_state None.
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Acquiring lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "f6fc8482-be81-4681-ad26-80af0fd7b3aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] No waiting events found dispatching network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:10 user nova-compute[72992]: WARNING nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Received unexpected event network-vif-plugged-d5992d13-88a8-42c9-9e41-54049b129e75 for instance with vm_state deleted and task_state None.
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-unplugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-unplugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-e75d6f9b-a1a0-4e9d-8f91-42bedfc1d57f req-a9343207-f564-4fbb-927d-346b0ef35c8f service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-unplugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:34:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Instance destroyed successfully.
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'resources' on Instance uuid 0a3e352a-c299-457f-98f4-b237d37d08e2 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:28:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-93833120',display_name='tempest-TestMinimumBasicScenario-server-93833120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-93833120',id=35,image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM758e131dMxuNl5wHFcAlusORhJpbVnzGYf1ccWKH3iXrzjiJGIcx3BZglMNH3aP1aKQ+ua6ZbqcU5IcQfuG9/ttMb0Sy7ojyLXTo7plfC/Xw4YAsOnnm+epD4oTxnWHw==',key_name='tempest-TestMinimumBasicScenario-749627438',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:29:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-q03r0rkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='45b8bf5e-667b-4182-9892-7fe510ef5a6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:31:28Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=0a3e352a-c299-457f-98f4-b237d37d08e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "address": "fa:16:3e:43:a8:5e", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377e089e-4e", "ovs_interfaceid": "377e089e-4e71-47ec-ba5c-bcd8f1f5b301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG os_vif [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap377e089e-4e, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:11 user nova-compute[72992]: INFO os_vif [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a8:5e,bridge_name='br-int',has_traffic_filtering=True,id=377e089e-4e71-47ec-ba5c-bcd8f1f5b301,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377e089e-4e')
Aug 15 21:34:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Deleting instance files /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2_del
Aug 15 21:34:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Deletion of /opt/stack/data/nova/instances/0a3e352a-c299-457f-98f4-b237d37d08e2_del complete
Aug 15 21:34:11 user nova-compute[72992]: INFO nova.compute.manager [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 21:34:11 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:11 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Took 0.59 seconds to deallocate network for instance.
Aug 15 21:34:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-f818bd33-8392-4914-9fce-66688b6cb947 req-ff695ef1-03e9-4553-916f-9d66619c3f89 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-deleted-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:12 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Deleted allocations for instance 0a3e352a-c299-457f-98f4-b237d37d08e2
Aug 15 21:34:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d4a751cc-57f7-46e2-b281-84ecd0d11b5d tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-2220188c-5b8e-4caa-b532-e330c352ac96 req-5cbf55fb-a4f4-4340-8642-7965f213f590 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2220188c-5b8e-4caa-b532-e330c352ac96 req-5cbf55fb-a4f4-4340-8642-7965f213f590 service nova] Acquiring lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2220188c-5b8e-4caa-b532-e330c352ac96 req-5cbf55fb-a4f4-4340-8642-7965f213f590 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2220188c-5b8e-4caa-b532-e330c352ac96 req-5cbf55fb-a4f4-4340-8642-7965f213f590 service nova] Lock "0a3e352a-c299-457f-98f4-b237d37d08e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-2220188c-5b8e-4caa-b532-e330c352ac96 req-5cbf55fb-a4f4-4340-8642-7965f213f590 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] No waiting events found dispatching network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:12 user nova-compute[72992]: WARNING nova.compute.manager [req-2220188c-5b8e-4caa-b532-e330c352ac96 req-5cbf55fb-a4f4-4340-8642-7965f213f590 service nova] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Received unexpected event network-vif-plugged-377e089e-4e71-47ec-ba5c-bcd8f1f5b301 for instance with vm_state deleted and task_state None.
Aug 15 21:34:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:34:20 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:34:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:23 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135248.8946764, f6fc8482-be81-4681-ad26-80af0fd7b3aa => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:34:23 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] VM Stopped (Lifecycle Event)
Aug 15 21:34:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b26f141c-a421-4aa9-94db-9815654a5b72 None None] [instance: f6fc8482-be81-4681-ad26-80af0fd7b3aa] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135251.1352112, 0a3e352a-c299-457f-98f4-b237d37d08e2 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:34:26 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] VM Stopped (Lifecycle Event)
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-911a8b8b-bcc2-4c14-95c0-21af38d0d88e None None] [instance: 0a3e352a-c299-457f-98f4-b237d37d08e2] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:26 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:34:26 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8011MB free_disk=25.356639862060547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 694668f4-1744-4a9c-a6cf-a1e710d0bad5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 754b808e-e692-42b2-9ab0-fc38e221fb2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:34:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating instance_info_cache with network_info: [{"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-d3234f5a-b582-45eb-9d1d-605b9c7c0e21" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:34:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:34:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:34:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-changed-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG nova.compute.manager [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Refreshing instance network info cache due to event network-changed-1fafb4da-a4b9-4e50-bf53-705bb593946a. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] Acquiring lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] Acquired lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Refreshing network info cache for port 1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'flavor' on Instance uuid 90b1ad6c-0531-4667-82ec-e8b60ed39f32 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:39 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Ignoring supplied device name: /dev/vdb
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:39 user nova-compute[72992]: INFO nova.compute.manager [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Attaching volume 98d8ff9b-d403-46b2-aca1-567fd9d6bd6d to /dev/vdb
Aug 15 21:34:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updated VIF entry in instance network info cache for port 1fafb4da-a4b9-4e50-bf53-705bb593946a. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG nova.network.neutron [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updating instance_info_cache with network_info: [{"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-811b6657-e2e9-44a3-b84b-cffdaceab95a req-b1664f49-9df3-40ac-b641-009249bf65d3 service nova] Releasing lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG os_brick.utils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98848c7-e231-46da-90f5-376ea8b36d88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[767456f0-d55e-44f8-b538-e2483d55f36d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27144d4-5b04-4b90-98d1-3ee5c710f932]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9468a856-e700-47b7-9a6b-f69260779b24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:34:39 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:34:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd93fad7-0f0b-4825-a8d1-a3c0061f0c5e]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:34:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:34:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:34:40 user nova-compute[72992]: DEBUG os_brick.utils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:34:40 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updating existing volume attachment record: e8b3dc80-f4c2-4ec1-afbc-3a1282ec4d6e {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:34:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:41 user nova-compute[72992]: INFO nova.compute.manager [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Unshelving
Aug 15 21:34:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:42 user nova-compute[72992]: DEBUG nova.objects.instance [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'pci_requests' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:42 user nova-compute[72992]: DEBUG nova.objects.instance [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'numa_topology' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:42 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:34:42 user nova-compute[72992]: INFO nova.compute.claims [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Claim successful on node user
Aug 15 21:34:42 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:34:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:34:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:42 user nova-compute[72992]: INFO nova.network.neutron [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating port 261cf3d1-ca1a-4f41-8941-05807eced0fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 21:34:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquired lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG nova.network.neutron [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing instance network info cache due to event network-changed-261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] Acquiring lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG nova.network.neutron [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Releasing lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:34:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Creating image(s)
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'trusted_certs' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] Acquired lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Refreshing network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "b5d6ba2d6721b765e9097b4898e6cbb84c29ff84" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "b5d6ba2d6721b765e9097b4898e6cbb84c29ff84" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.part --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG nova.virt.images [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] 4af743a9-0c2f-4cea-a04c-509c3849fe47 was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.part /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:45 user nova-compute[72992]: INFO nova.compute.manager [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Terminating instance
Aug 15 21:34:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.part /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.converted" returned: 0 in 0.511s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG nova.network.neutron [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updated VIF entry in instance network info cache for port 261cf3d1-ca1a-4f41-8941-05807eced0fc. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG nova.network.neutron [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9a565a4a-3762-4d5f-a89d-d9f35233930e req-d8753181-0760-4e70-af17-08c1f9647847 service nova] Releasing lock "refresh_cache-fcef2646-8b98-472e-96c0-382a6651336e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "b5d6ba2d6721b765e9097b4898e6cbb84c29ff84" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.922s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-1c529d07-7f50-4619-86de-955fc672bd6b req-ff144d49-f220-4983-8c3a-0204775d86a2 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received event network-vif-unplugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1c529d07-7f50-4619-86de-955fc672bd6b req-ff144d49-f220-4983-8c3a-0204775d86a2 service nova] Acquiring lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1c529d07-7f50-4619-86de-955fc672bd6b req-ff144d49-f220-4983-8c3a-0204775d86a2 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1c529d07-7f50-4619-86de-955fc672bd6b req-ff144d49-f220-4983-8c3a-0204775d86a2 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-1c529d07-7f50-4619-86de-955fc672bd6b req-ff144d49-f220-4983-8c3a-0204775d86a2 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] No waiting events found dispatching network-vif-unplugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-1c529d07-7f50-4619-86de-955fc672bd6b req-ff144d49-f220-4983-8c3a-0204775d86a2 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received event network-vif-unplugged-25b79100-ed86-466a-8538-42c3e1771cf6 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84 --force-share --output=json" returned: 0 in 0.392s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "b5d6ba2d6721b765e9097b4898e6cbb84c29ff84" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "b5d6ba2d6721b765e9097b4898e6cbb84c29ff84" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Instance destroyed successfully.
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.objects.instance [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lazy-loading 'resources' on Instance uuid 694668f4-1744-4a9c-a6cf-a1e710d0bad5 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897907848',display_name='tempest-VolumesActionsTest-instance-897907848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897907848',id=39,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50414be7f9af4d2e925fc7c7bba85a61',ramdisk_id='',reservation_id='r-zk5g9t8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1453664454',owner_user_name='tempest-VolumesActionsTest-1453664454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:32:52Z,user_data=None,user_id='69816aed428443df9cd5423ab3924c9f',uuid=694668f4-1744-4a9c-a6cf-a1e710d0bad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Converting VIF {"id": "25b79100-ed86-466a-8538-42c3e1771cf6", "address": "fa:16:3e:bc:cb:72", "network": {"id": "5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1933854966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50414be7f9af4d2e925fc7c7bba85a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25b79100-ed", "ovs_interfaceid": "25b79100-ed86-466a-8538-42c3e1771cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:cb:72,bridge_name='br-int',has_traffic_filtering=True,id=25b79100-ed86-466a-8538-42c3e1771cf6,network=Network(5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b79100-ed') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG os_vif [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:cb:72,bridge_name='br-int',has_traffic_filtering=True,id=25b79100-ed86-466a-8538-42c3e1771cf6,network=Network(5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b79100-ed') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25b79100-ed, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:34:46 user nova-compute[72992]: INFO os_vif [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:cb:72,bridge_name='br-int',has_traffic_filtering=True,id=25b79100-ed86-466a-8538-42c3e1771cf6,network=Network(5edc7a2e-bd8d-42ad-91dc-7a6bc83b0a5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25b79100-ed')
Aug 15 21:34:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Deleting instance files /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5_del
Aug 15 21:34:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Deletion of /opt/stack/data/nova/instances/694668f4-1744-4a9c-a6cf-a1e710d0bad5_del complete
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-changed-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Refreshing instance network info cache due to event network-changed-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] Acquiring lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] Acquired lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.network.neutron [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Refreshing network info cache for port d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:34:46 user nova-compute[72992]: INFO nova.compute.manager [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84 --force-share --output=json" returned: 0 in 0.243s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84,backing_fmt=raw /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84,backing_fmt=raw /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk 1073741824" returned: 0 in 0.057s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "b5d6ba2d6721b765e9097b4898e6cbb84c29ff84" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84 --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84 --force-share --output=json" returned: 0 in 0.195s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG nova.objects.instance [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'migration_context' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Rebasing disk image.
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d -F raw /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updated VIF entry in instance network info cache for port d16baeb8-bc61-4b6c-ab85-fbb2ff1af049. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG nova.network.neutron [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e14872f4-44c9-4eeb-8e5c-7ddad3e8bcba req-5ff103ef-fe3a-4637-a3d3-eac7f972093a service nova] Releasing lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:47 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Took 1.38 seconds to deallocate network for instance.
Aug 15 21:34:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-3796a78a-3e02-4ac3-b00b-bcc57b20a474 req-9a9325b0-f56a-42fb-aee4-346dce87c1c4 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received event network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3796a78a-3e02-4ac3-b00b-bcc57b20a474 req-9a9325b0-f56a-42fb-aee4-346dce87c1c4 service nova] Acquiring lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3796a78a-3e02-4ac3-b00b-bcc57b20a474 req-9a9325b0-f56a-42fb-aee4-346dce87c1c4 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3796a78a-3e02-4ac3-b00b-bcc57b20a474 req-9a9325b0-f56a-42fb-aee4-346dce87c1c4 service nova] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-3796a78a-3e02-4ac3-b00b-bcc57b20a474 req-9a9325b0-f56a-42fb-aee4-346dce87c1c4 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] No waiting events found dispatching network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:47 user nova-compute[72992]: WARNING nova.compute.manager [req-3796a78a-3e02-4ac3-b00b-bcc57b20a474 req-9a9325b0-f56a-42fb-aee4-346dce87c1c4 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received unexpected event network-vif-plugged-25b79100-ed86-466a-8538-42c3e1771cf6 for instance with vm_state active and task_state deleting.
Aug 15 21:34:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:48 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Deleted allocations for instance 694668f4-1744-4a9c-a6cf-a1e710d0bad5
Aug 15 21:34:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-changed-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Refreshing instance network info cache due to event network-changed-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG nova.network.neutron [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Refreshing network info cache for port 13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:34:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-027c7d9d-8e21-49aa-ab95-49db76a7abaa tempest-VolumesActionsTest-1453664454 tempest-VolumesActionsTest-1453664454-project-member] Lock "694668f4-1744-4a9c-a6cf-a1e710d0bad5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.091s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updated VIF entry in instance network info cache for port 13eb4425-57ab-4c0c-b0dd-f81b789ddc1e. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.network.neutron [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.compute.manager [req-ea85ef6c-6102-400e-9d24-e1bf5233de20 req-064c9afc-4681-44c2-a635-0aa4a56506c4 service nova] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Received event network-vif-deleted-25b79100-ed86-466a-8538-42c3e1771cf6 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Stashing vm_state: active {{(pid=72992) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'pci_requests' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:34:49 user nova-compute[72992]: INFO nova.compute.claims [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Claim successful on node user
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'resources' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'pci_devices' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:49 user nova-compute[72992]: INFO nova.compute.resource_tracker [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating resource usage from migration d98f1af4-ad75-4954-b047-bdd7e79a718d
Aug 15 21:34:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d -F raw /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk" returned: 0 in 2.953s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Ensure instance console log exists: /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Start _get_guest_xml network_info=[{"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='dcda429e2565cae15b5ac1734a9c4bbf',container_format='bare',created_at=2023-08-15T21:32:48Z,direct_url=<?>,disk_format='qcow2',id=4af743a9-0c2f-4cea-a04c-509c3849fe47,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-742986768-shelved',owner='9937b37364574383bb2bee6622aa04c2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T21:32:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:34:49 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:34:49 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='dcda429e2565cae15b5ac1734a9c4bbf',container_format='bare',created_at=2023-08-15T21:32:48Z,direct_url=<?>,disk_format='qcow2',id=4af743a9-0c2f-4cea-a04c-509c3849fe47,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-742986768-shelved',owner='9937b37364574383bb2bee6622aa04c2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T21:32:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'vcpu_model' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742986768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742986768',id=37,image_ref='4af743a9-0c2f-4cea-a04c-509c3849fe47',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1083363969',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:30:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-h8amg216',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member',shelved_at='2023-08-15T21:32:53.429349',shelved_host='user',shelved_image_id='4af743a9-0c2f-4cea-a04c-509c3849fe47'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=fcef2646-8b98-472e-96c0-382a6651336e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.objects.instance [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'pci_devices' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.447s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:50 user nova-compute[72992]: INFO nova.compute.manager [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Migrating
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:34:50 user nova-compute[72992]:   <uuid>fcef2646-8b98-472e-96c0-382a6651336e</uuid>
Aug 15 21:34:50 user nova-compute[72992]:   <name>instance-00000025</name>
Aug 15 21:34:50 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:34:50 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:34:50 user nova-compute[72992]:   <metadata>
Aug 15 21:34:50 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:34:50 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:34:50 user nova-compute[72992]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-742986768</nova:name>
Aug 15 21:34:50 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:34:49</nova:creationTime>
Aug 15 21:34:50 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:34:50 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:34:50 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:34:50 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:34:50 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:34:50 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:34:50 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:34:50 user nova-compute[72992]:       <nova:owner>
Aug 15 21:34:50 user nova-compute[72992]:         <nova:user uuid="426fd37dacd64b46b9f8e5d93f052265">tempest-AttachVolumeShelveTestJSON-1272311701-project-member</nova:user>
Aug 15 21:34:50 user nova-compute[72992]:         <nova:project uuid="9937b37364574383bb2bee6622aa04c2">tempest-AttachVolumeShelveTestJSON-1272311701</nova:project>
Aug 15 21:34:50 user nova-compute[72992]:       </nova:owner>
Aug 15 21:34:50 user nova-compute[72992]:       <nova:root type="image" uuid="4af743a9-0c2f-4cea-a04c-509c3849fe47"/>
Aug 15 21:34:50 user nova-compute[72992]:       <nova:ports>
Aug 15 21:34:50 user nova-compute[72992]:         <nova:port uuid="261cf3d1-ca1a-4f41-8941-05807eced0fc">
Aug 15 21:34:50 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 21:34:50 user nova-compute[72992]:         </nova:port>
Aug 15 21:34:50 user nova-compute[72992]:       </nova:ports>
Aug 15 21:34:50 user nova-compute[72992]:     </nova:instance>
Aug 15 21:34:50 user nova-compute[72992]:   </metadata>
Aug 15 21:34:50 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:34:50 user nova-compute[72992]:     <system>
Aug 15 21:34:50 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:34:50 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:34:50 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:34:50 user nova-compute[72992]:       <entry name="serial">fcef2646-8b98-472e-96c0-382a6651336e</entry>
Aug 15 21:34:50 user nova-compute[72992]:       <entry name="uuid">fcef2646-8b98-472e-96c0-382a6651336e</entry>
Aug 15 21:34:50 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:34:50 user nova-compute[72992]:     </system>
Aug 15 21:34:50 user nova-compute[72992]:   </sysinfo>
Aug 15 21:34:50 user nova-compute[72992]:   <os>
Aug 15 21:34:50 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:34:50 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:34:50 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:34:50 user nova-compute[72992]:   </os>
Aug 15 21:34:50 user nova-compute[72992]:   <features>
Aug 15 21:34:50 user nova-compute[72992]:     <acpi/>
Aug 15 21:34:50 user nova-compute[72992]:     <apic/>
Aug 15 21:34:50 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:34:50 user nova-compute[72992]:   </features>
Aug 15 21:34:50 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:34:50 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:34:50 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:34:50 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:34:50 user nova-compute[72992]:   </clock>
Aug 15 21:34:50 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:34:50 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:34:50 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:34:50 user nova-compute[72992]:   </cpu>
Aug 15 21:34:50 user nova-compute[72992]:   <devices>
Aug 15 21:34:50 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:34:50 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:34:50 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk"/>
Aug 15 21:34:50 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:34:50 user nova-compute[72992]:     </disk>
Aug 15 21:34:50 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:34:50 user nova-compute[72992]:       <mac address="fa:16:3e:da:b4:56"/>
Aug 15 21:34:50 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:34:50 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:34:50 user nova-compute[72992]:       <target dev="tap261cf3d1-ca"/>
Aug 15 21:34:50 user nova-compute[72992]:     </interface>
Aug 15 21:34:50 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:34:50 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/console.log" append="off"/>
Aug 15 21:34:50 user nova-compute[72992]:     </serial>
Aug 15 21:34:50 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:34:50 user nova-compute[72992]:     <video>
Aug 15 21:34:50 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:34:50 user nova-compute[72992]:     </video>
Aug 15 21:34:50 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:34:50 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:34:50 user nova-compute[72992]:     </rng>
Aug 15 21:34:50 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:34:50 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:34:50 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:34:50 user nova-compute[72992]:     </memballoon>
Aug 15 21:34:50 user nova-compute[72992]:   </devices>
Aug 15 21:34:50 user nova-compute[72992]: </domain>
Aug 15 21:34:50 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742986768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742986768',id=37,image_ref='4af743a9-0c2f-4cea-a04c-509c3849fe47',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1083363969',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:30:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-h8amg216',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member',shelved_at='2023-08-15T21:32:53.429349',shelved_host='user',shelved_image_id='4af743a9-0c2f-4cea-a04c-509c3849fe47'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=fcef2646-8b98-472e-96c0-382a6651336e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_vif [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:34:50 user nova-compute[72992]: INFO nova.compute.rpcapi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap261cf3d1-ca, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap261cf3d1-ca, col_values=(('external_ids', {'iface-id': '261cf3d1-ca1a-4f41-8941-05807eced0fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:b4:56', 'vm-uuid': 'fcef2646-8b98-472e-96c0-382a6651336e'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeaKANbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:34:50 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:34:50 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:34:50 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:50 user nova-compute[72992]: INFO os_vif [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca')
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[542d6f55-da7f-4946-9e70-b45974f66c3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:34:50 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3777c0fb-b5d0-4f2e-b2c6-d3899d42809b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d] added
Aug 15 21:34:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da2bbf9-8c0d-44fa-add0-1259c8ad01e6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] No VIF found with MAC fa:16:3e:da:b4:56, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfb3e3-d623-484e-841a-4c065f1dd5c4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeaKANbs {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeaKANbs" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[380dbe2c-5464-4f6f-923c-1d396f9cf44c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EeaKANbs'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c363068-480f-499e-8903-0581ba494c89]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[74789d69-a570-4c18-8c0f-705c0285a969]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb73bc-5a1f-4ed1-b03f-caf963c44d38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260]
Aug 15 21:34:50 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260] successful.
Aug 15 21:34:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8818f1-731e-4ddc-abba-157f1417d7ef]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e65aab-b964-42ea-bfc7-5213f9dd2f9f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:50 user nova-compute[72992]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:34:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:50 user nova-compute[72992]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:34:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e06898-ab4b-48dd-b15f-69b9cd63f980]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Starting migrate_disk_and_power_off {{(pid=72992) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-b9461623-54b8-4f6b-80a2-941fdfbda50f req-18d8fef5-bf57-4f39-bbf4-226f3097d5cb service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-unplugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b9461623-54b8-4f6b-80a2-941fdfbda50f req-18d8fef5-bf57-4f39-bbf4-226f3097d5cb service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b9461623-54b8-4f6b-80a2-941fdfbda50f req-18d8fef5-bf57-4f39-bbf4-226f3097d5cb service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b9461623-54b8-4f6b-80a2-941fdfbda50f req-18d8fef5-bf57-4f39-bbf4-226f3097d5cb service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-b9461623-54b8-4f6b-80a2-941fdfbda50f req-18d8fef5-bf57-4f39-bbf4-226f3097d5cb service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-unplugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:51 user nova-compute[72992]: WARNING nova.compute.manager [req-b9461623-54b8-4f6b-80a2-941fdfbda50f req-18d8fef5-bf57-4f39-bbf4-226f3097d5cb service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received unexpected event network-vif-unplugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with vm_state active and task_state resize_migrating.
Aug 15 21:34:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeaKANbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23030306132626263', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030306132626263', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'flavor' on Instance uuid 90b1ad6c-0531-4667-82ec-e8b60ed39f32 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:34:51 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:34:51 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:34:51 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:34:51 user nova-compute[72992]:   <serial>98d8ff9b-d403-46b2-aca1-567fd9d6bd6d</serial>
Aug 15 21:34:51 user nova-compute[72992]: </disk>
Aug 15 21:34:51 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance destroyed successfully.
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-936163427',display_name='tempest-ServerActionsTestOtherA-server-936163427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-936163427',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-t1d00ezo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=754b808e-e692-42b2-9ab0-fc38e221fb2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1056004259-network", "vif_mac": "fa:16:3e:34:08:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1056004259-network", "vif_mac": "fa:16:3e:34:08:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_vif [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13eb4425-57, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:34:52 user nova-compute[72992]: INFO os_vif [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57')
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:34:52 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f9008e-006c-417e-89c0-5919127f5440]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No VIF found with MAC fa:16:3e:2b:61:22, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[590912ce-6279-4e29-b9f7-c537c63be9ee]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:52 user nova-compute[72992]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:34:52 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:34:52 user nova-compute[72992]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:34:52 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c8851c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.077s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b05223-8349-4c31-98e3-93ff6b8c39a5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeb49a4-f327-4782-8fb4-f8c2a3333833]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8643042a-6fb9-4ea7-8b6d-0fa8cb46f769]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e71132-3c33-4685-8c0f-5ab430e6f66f]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdba66d8-8af0-477d-a5e9-1bb945ea96cd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d81769c9-ddb2-4c1a-ad3e-584f95d017ec tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.105s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6aac1b-2274-4a13-9b7c-efa1984eaf49]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]
Aug 15 21:34:52 user nova-compute[72992]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.
Aug 15 21:34:52 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2708c5dd-8ee8-4ddd-8f4a-36a2a29d199a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== disconnect_volume: return (367ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:34:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:53 user nova-compute[72992]: WARNING nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received unexpected event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with vm_state active and task_state resize_migrating.
Aug 15 21:34:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:53 user nova-compute[72992]: WARNING nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received unexpected event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 21:34:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:34:53 user nova-compute[72992]: WARNING nova.compute.manager [req-9ae3730a-ab3e-4c74-ae54-fbcd80d25e77 req-ae1a847f-6660-488a-be91-bd05fb3ca2bc service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received unexpected event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 21:34:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Port 13eb4425-57ab-4c0c-b0dd-f81b789ddc1e binding to destination host user is already ACTIVE {{(pid=72992) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135294.5326757, fcef2646-8b98-472e-96c0-382a6651336e => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:34:54 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] VM Resumed (Lifecycle Event)
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:34:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance spawned successfully.
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:34:54 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135294.53357, fcef2646-8b98-472e-96c0-382a6651336e => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:34:54 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] VM Started (Lifecycle Event)
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:34:54 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:34:54 user nova-compute[72992]: DEBUG os_brick.utils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd847d5-510e-4173-851b-2fba4222f48d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4598fa-d1ea-42bf-bbf9-b3ca58bb82fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac5d6be-2e7b-4b9b-ae50-446632201b2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c0612d-f491-4c33-a31f-1bdf8edce18f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dc2afdf9-7b64-4074-b623-8c3110afa398 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.939s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:34:54 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:34:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c41071a-157b-4820-9aad-0b902c4245dc]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:34:54 user nova-compute[72992]: DEBUG os_brick.utils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:34:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:34:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:01 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135286.2816443, 694668f4-1744-4a9c-a6cf-a1e710d0bad5 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:35:01 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] VM Stopped (Lifecycle Event)
Aug 15 21:35:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-cf9c8e5a-e40c-4c5c-8cb9-47b929f5db7a None None] [instance: 694668f4-1744-4a9c-a6cf-a1e710d0bad5] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:35:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:35:05 user nova-compute[72992]: INFO nova.compute.claims [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Claim successful on node user
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Starting finish_migration {{(pid=72992) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:35:05 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Creating image(s)
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Ensure instance console log exists: /opt/stack/data/nova/instances/754b808e-e692-42b2-9ab0-fc38e221fb2a/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Start _get_guest_xml network_info=[{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1056004259-network", "vif_mac": "fa:16:3e:34:08:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '754b808e-e692-42b2-9ab0-fc38e221fb2a', 'attached_at': '2023-08-15T21:35:05.000000', 'detached_at': '', 'volume_id': 'd51d7980-48d7-4f6d-9da7-07527f156eaf', 'serial': 'd51d7980-48d7-4f6d-9da7-07527f156eaf'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '69e284f5-eeb2-4e8f-877d-7c9504c3ac5a', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:35:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:35:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'vcpu_model' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:35:05 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:35:05 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:35:05 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf59e80-b770-48ba-a087-8c00a314e679]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:35:05 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5853fc5b-fb64-4b2b-a390-43bc9fc0c7fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf] added
Aug 15 21:35:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[90742199-f5a8-4a32-bf49-9c5420eeff10]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92c5c9c-a71a-4227-ac42-a7cd87bcdc72]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRgyYixr {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRgyYixr" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa8b43-1a2d-44bc-88de-6e821fd774dc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRgyYixr'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74f3c7b-a696-49a2-af48-61dc600f1a1f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9733a1e7-38dd-4dc5-96af-3f6f3b215a27]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:35:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:35:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5215617f-c668-40db-ab39-41256bee8005]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]
Aug 15 21:35:05 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.
Aug 15 21:35:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[734fbb73-6218-4f11-9237-96af720a104c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:05 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5ab405-628a-4e8d-9099-b7ecb35e4063]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:35:05 user nova-compute[72992]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:35:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:35:05 user nova-compute[72992]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:35:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3259f7-31e2-4a70-ad34-48ce96f0f109]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.policy [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '478df679862f4c3a9887beb0fd2518c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '626d22c8835e4819aadcf9cbe0180dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:35:05 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Creating image(s)
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "/opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "/opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "b78397bf7bec2a57b324a383ebbfcafc342e1ddf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "b78397bf7bec2a57b324a383ebbfcafc342e1ddf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.part --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.part --force-share --output=json" returned: 0 in 0.245s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.virt.images [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] 30b7e569-63f4-4e80-93b6-8b07a1ee621a was qcow2, converting to raw {{(pid=72992) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.privsep.utils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72992) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.part /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.converted {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Successfully created port: f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23934383636373336', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934383636373336', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-936163427',display_name='tempest-ServerActionsTestOtherA-server-936163427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-936163427',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-t1d00ezo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=754b808e-e692-42b2-9ab0-fc38e221fb2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1056004259-network", "vif_mac": "fa:16:3e:34:08:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1056004259-network", "vif_mac": "fa:16:3e:34:08:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:35:06 user nova-compute[72992]:   <uuid>754b808e-e692-42b2-9ab0-fc38e221fb2a</uuid>
Aug 15 21:35:06 user nova-compute[72992]:   <name>instance-00000029</name>
Aug 15 21:35:06 user nova-compute[72992]:   <memory>2097152</memory>
Aug 15 21:35:06 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:35:06 user nova-compute[72992]:   <metadata>
Aug 15 21:35:06 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:35:06 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:35:06 user nova-compute[72992]:       <nova:name>tempest-ServerActionsTestOtherA-server-936163427</nova:name>
Aug 15 21:35:06 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:35:05</nova:creationTime>
Aug 15 21:35:06 user nova-compute[72992]:       <nova:flavor name="m1.small">
Aug 15 21:35:06 user nova-compute[72992]:         <nova:memory>2048</nova:memory>
Aug 15 21:35:06 user nova-compute[72992]:         <nova:disk>20</nova:disk>
Aug 15 21:35:06 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:35:06 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:35:06 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:35:06 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:35:06 user nova-compute[72992]:       <nova:owner>
Aug 15 21:35:06 user nova-compute[72992]:         <nova:user uuid="9192e3fb208c401190105a465161ad70">tempest-ServerActionsTestOtherA-752735396-project-member</nova:user>
Aug 15 21:35:06 user nova-compute[72992]:         <nova:project uuid="386bc7deac3d4d57ae29c8461335ca0e">tempest-ServerActionsTestOtherA-752735396</nova:project>
Aug 15 21:35:06 user nova-compute[72992]:       </nova:owner>
Aug 15 21:35:06 user nova-compute[72992]:       <nova:ports>
Aug 15 21:35:06 user nova-compute[72992]:         <nova:port uuid="13eb4425-57ab-4c0c-b0dd-f81b789ddc1e">
Aug 15 21:35:06 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:35:06 user nova-compute[72992]:         </nova:port>
Aug 15 21:35:06 user nova-compute[72992]:       </nova:ports>
Aug 15 21:35:06 user nova-compute[72992]:     </nova:instance>
Aug 15 21:35:06 user nova-compute[72992]:   </metadata>
Aug 15 21:35:06 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:35:06 user nova-compute[72992]:     <system>
Aug 15 21:35:06 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:35:06 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:35:06 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:35:06 user nova-compute[72992]:       <entry name="serial">754b808e-e692-42b2-9ab0-fc38e221fb2a</entry>
Aug 15 21:35:06 user nova-compute[72992]:       <entry name="uuid">754b808e-e692-42b2-9ab0-fc38e221fb2a</entry>
Aug 15 21:35:06 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:35:06 user nova-compute[72992]:     </system>
Aug 15 21:35:06 user nova-compute[72992]:   </sysinfo>
Aug 15 21:35:06 user nova-compute[72992]:   <os>
Aug 15 21:35:06 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:35:06 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:35:06 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:35:06 user nova-compute[72992]:   </os>
Aug 15 21:35:06 user nova-compute[72992]:   <features>
Aug 15 21:35:06 user nova-compute[72992]:     <acpi/>
Aug 15 21:35:06 user nova-compute[72992]:     <apic/>
Aug 15 21:35:06 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:35:06 user nova-compute[72992]:   </features>
Aug 15 21:35:06 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:35:06 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:35:06 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:35:06 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:35:06 user nova-compute[72992]:   </clock>
Aug 15 21:35:06 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:35:06 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:35:06 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:35:06 user nova-compute[72992]:   </cpu>
Aug 15 21:35:06 user nova-compute[72992]:   <devices>
Aug 15 21:35:06 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:35:06 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:35:06 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:35:06 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:35:06 user nova-compute[72992]:       <serial>d51d7980-48d7-4f6d-9da7-07527f156eaf</serial>
Aug 15 21:35:06 user nova-compute[72992]:     </disk>
Aug 15 21:35:06 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:35:06 user nova-compute[72992]:       <mac address="fa:16:3e:34:08:6f"/>
Aug 15 21:35:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:35:06 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:35:06 user nova-compute[72992]:       <target dev="tap13eb4425-57"/>
Aug 15 21:35:06 user nova-compute[72992]:     </interface>
Aug 15 21:35:06 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:35:06 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/754b808e-e692-42b2-9ab0-fc38e221fb2a/console.log" append="off"/>
Aug 15 21:35:06 user nova-compute[72992]:     </serial>
Aug 15 21:35:06 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:35:06 user nova-compute[72992]:     <video>
Aug 15 21:35:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:35:06 user nova-compute[72992]:     </video>
Aug 15 21:35:06 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:35:06 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:35:06 user nova-compute[72992]:     </rng>
Aug 15 21:35:06 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:35:06 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:35:06 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:35:06 user nova-compute[72992]:     </memballoon>
Aug 15 21:35:06 user nova-compute[72992]:   </devices>
Aug 15 21:35:06 user nova-compute[72992]: </domain>
Aug 15 21:35:06 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-936163427',display_name='tempest-ServerActionsTestOtherA-server-936163427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-936163427',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-t1d00ezo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:34:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=754b808e-e692-42b2-9ab0-fc38e221fb2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1056004259-network", "vif_mac": "fa:16:3e:34:08:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1056004259-network", "vif_mac": "fa:16:3e:34:08:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG os_vif [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13eb4425-57, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13eb4425-57, col_values=(('external_ids', {'iface-id': '13eb4425-57ab-4c0c-b0dd-f81b789ddc1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:08:6f', 'vm-uuid': '754b808e-e692-42b2-9ab0-fc38e221fb2a'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:35:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:06 user nova-compute[72992]: INFO os_vif [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57')
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] No VIF found with MAC fa:16:3e:34:08:6f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.part /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.converted" returned: 0 in 0.427s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.converted --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "b78397bf7bec2a57b324a383ebbfcafc342e1ddf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.439s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135292.5291684, 754b808e-e692-42b2-9ab0-fc38e221fb2a => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:35:07 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] VM Stopped (Lifecycle Event)
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-755242e5-c2a7-4956-b33c-7e004e6f4922 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "b78397bf7bec2a57b324a383ebbfcafc342e1ddf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "b78397bf7bec2a57b324a383ebbfcafc342e1ddf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Successfully updated port: f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing instance network info cache due to event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf --force-share --output=json" returned: 0 in 0.225s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf,backing_fmt=raw /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf,backing_fmt=raw /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk 1073741824" returned: 0 in 0.070s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "b78397bf7bec2a57b324a383ebbfcafc342e1ddf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf --force-share --output=json" returned: 0 in 0.297s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance network_info: |[{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.network.neutron [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Cannot resize image /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'migration_context' on Instance uuid 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Ensure instance console log exists: /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Start _get_guest_xml network_info=[{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:35:02Z,direct_url=<?>,disk_format='qcow2',id=30b7e569-63f4-4e80-93b6-8b07a1ee621a,min_disk=0,min_ram=0,name='tempest-scenario-img--515968729',owner='626d22c8835e4819aadcf9cbe0180dc1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:35:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': '30b7e569-63f4-4e80-93b6-8b07a1ee621a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:35:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:35:08 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:35:02Z,direct_url=<?>,disk_format='qcow2',id=30b7e569-63f4-4e80-93b6-8b07a1ee621a,min_disk=0,min_ram=0,name='tempest-scenario-img--515968729',owner='626d22c8835e4819aadcf9cbe0180dc1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:35:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1789099430',display_name='tempest-TestMinimumBasicScenario-server-1789099430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1789099430',id=42,image_ref='30b7e569-63f4-4e80-93b6-8b07a1ee621a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/4OTpWU49MyvicFQEg0z/coi/FTVr2MzPNTwQZYwd7AKyJE7eBqHX4ErvicJQupcTG0QBYHv+Mt5e4+2M4hjeMo0fzZmTQF0IvhOm1QFN8ISOpUrki8q/I/cY/3UlQPQ==',key_name='tempest-TestMinimumBasicScenario-1732605881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-oznuxq7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30b7e569-63f4-4e80-93b6-8b07a1ee621a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:35:06Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=7f5d96ae-d869-4100-b3cd-b68eeacdff6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:47:f8,bridge_name='br-int',has_traffic_filtering=True,id=f9e74969-4101-4a49-a2f4-e77b297f993c,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e74969-41') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:35:08 user nova-compute[72992]:   <uuid>7f5d96ae-d869-4100-b3cd-b68eeacdff6e</uuid>
Aug 15 21:35:08 user nova-compute[72992]:   <name>instance-0000002a</name>
Aug 15 21:35:08 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:35:08 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:35:08 user nova-compute[72992]:   <metadata>
Aug 15 21:35:08 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:35:08 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:35:08 user nova-compute[72992]:       <nova:name>tempest-TestMinimumBasicScenario-server-1789099430</nova:name>
Aug 15 21:35:08 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:35:08</nova:creationTime>
Aug 15 21:35:08 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:35:08 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:35:08 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:35:08 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:35:08 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:35:08 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:35:08 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:35:08 user nova-compute[72992]:       <nova:owner>
Aug 15 21:35:08 user nova-compute[72992]:         <nova:user uuid="478df679862f4c3a9887beb0fd2518c7">tempest-TestMinimumBasicScenario-543863856-project-member</nova:user>
Aug 15 21:35:08 user nova-compute[72992]:         <nova:project uuid="626d22c8835e4819aadcf9cbe0180dc1">tempest-TestMinimumBasicScenario-543863856</nova:project>
Aug 15 21:35:08 user nova-compute[72992]:       </nova:owner>
Aug 15 21:35:08 user nova-compute[72992]:       <nova:root type="image" uuid="30b7e569-63f4-4e80-93b6-8b07a1ee621a"/>
Aug 15 21:35:08 user nova-compute[72992]:       <nova:ports>
Aug 15 21:35:08 user nova-compute[72992]:         <nova:port uuid="f9e74969-4101-4a49-a2f4-e77b297f993c">
Aug 15 21:35:08 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 21:35:08 user nova-compute[72992]:         </nova:port>
Aug 15 21:35:08 user nova-compute[72992]:       </nova:ports>
Aug 15 21:35:08 user nova-compute[72992]:     </nova:instance>
Aug 15 21:35:08 user nova-compute[72992]:   </metadata>
Aug 15 21:35:08 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:35:08 user nova-compute[72992]:     <system>
Aug 15 21:35:08 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:35:08 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:35:08 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:35:08 user nova-compute[72992]:       <entry name="serial">7f5d96ae-d869-4100-b3cd-b68eeacdff6e</entry>
Aug 15 21:35:08 user nova-compute[72992]:       <entry name="uuid">7f5d96ae-d869-4100-b3cd-b68eeacdff6e</entry>
Aug 15 21:35:08 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:35:08 user nova-compute[72992]:     </system>
Aug 15 21:35:08 user nova-compute[72992]:   </sysinfo>
Aug 15 21:35:08 user nova-compute[72992]:   <os>
Aug 15 21:35:08 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:35:08 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:35:08 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:35:08 user nova-compute[72992]:   </os>
Aug 15 21:35:08 user nova-compute[72992]:   <features>
Aug 15 21:35:08 user nova-compute[72992]:     <acpi/>
Aug 15 21:35:08 user nova-compute[72992]:     <apic/>
Aug 15 21:35:08 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:35:08 user nova-compute[72992]:   </features>
Aug 15 21:35:08 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:35:08 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:35:08 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:35:08 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:35:08 user nova-compute[72992]:   </clock>
Aug 15 21:35:08 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:35:08 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:35:08 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:35:08 user nova-compute[72992]:   </cpu>
Aug 15 21:35:08 user nova-compute[72992]:   <devices>
Aug 15 21:35:08 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:35:08 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:35:08 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk"/>
Aug 15 21:35:08 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:35:08 user nova-compute[72992]:     </disk>
Aug 15 21:35:08 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:35:08 user nova-compute[72992]:       <mac address="fa:16:3e:d9:47:f8"/>
Aug 15 21:35:08 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:35:08 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:35:08 user nova-compute[72992]:       <target dev="tapf9e74969-41"/>
Aug 15 21:35:08 user nova-compute[72992]:     </interface>
Aug 15 21:35:08 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:35:08 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/console.log" append="off"/>
Aug 15 21:35:08 user nova-compute[72992]:     </serial>
Aug 15 21:35:08 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:35:08 user nova-compute[72992]:     <video>
Aug 15 21:35:08 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:35:08 user nova-compute[72992]:     </video>
Aug 15 21:35:08 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:35:08 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:35:08 user nova-compute[72992]:     </rng>
Aug 15 21:35:08 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:35:08 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:35:08 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:35:08 user nova-compute[72992]:     </memballoon>
Aug 15 21:35:08 user nova-compute[72992]:   </devices>
Aug 15 21:35:08 user nova-compute[72992]: </domain>
Aug 15 21:35:08 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1789099430',display_name='tempest-TestMinimumBasicScenario-server-1789099430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1789099430',id=42,image_ref='30b7e569-63f4-4e80-93b6-8b07a1ee621a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/4OTpWU49MyvicFQEg0z/coi/FTVr2MzPNTwQZYwd7AKyJE7eBqHX4ErvicJQupcTG0QBYHv+Mt5e4+2M4hjeMo0fzZmTQF0IvhOm1QFN8ISOpUrki8q/I/cY/3UlQPQ==',key_name='tempest-TestMinimumBasicScenario-1732605881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-oznuxq7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30b7e569-63f4-4e80-93b6-8b07a1ee621a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:35:06Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=7f5d96ae-d869-4100-b3cd-b68eeacdff6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:47:f8,bridge_name='br-int',has_traffic_filtering=True,id=f9e74969-4101-4a49-a2f4-e77b297f993c,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e74969-41') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG os_vif [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:47:f8,bridge_name='br-int',has_traffic_filtering=True,id=f9e74969-4101-4a49-a2f4-e77b297f993c,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e74969-41') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9e74969-41, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9e74969-41, col_values=(('external_ids', {'iface-id': 'f9e74969-4101-4a49-a2f4-e77b297f993c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:47:f8', 'vm-uuid': '7f5d96ae-d869-4100-b3cd-b68eeacdff6e'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: INFO os_vif [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:47:f8,bridge_name='br-int',has_traffic_filtering=True,id=f9e74969-4101-4a49-a2f4-e77b297f993c,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e74969-41')
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updated VIF entry in instance network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3e5ada32-6a46-4a47-ac6a-fd4eb78dd756 req-b7f31f65-aac1-4d94-88fe-0534b9f6ca79 service nova] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No VIF found with MAC fa:16:3e:d9:47:f8, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:09 user nova-compute[72992]: WARNING nova.compute.manager [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received unexpected event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with vm_state active and task_state resize_finish.
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:09 user nova-compute[72992]: WARNING nova.compute.manager [req-43129e34-0de2-41f4-b46e-955b6411cba5 req-f25c497a-425b-49ea-9522-53a951addd3d service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received unexpected event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with vm_state active and task_state resize_finish.
Aug 15 21:35:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135311.0830352, 754b808e-e692-42b2-9ab0-fc38e221fb2a => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:35:11 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] VM Resumed (Lifecycle Event)
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:35:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance running successfully.
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Failed to set time: agent not configured {{(pid=72992) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28093c06-8f13-4959-b4e6-932e025e0374 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] finish_migration finished successfully. {{(pid=72992) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-f4aa6bed-3997-41e1-870a-d5e84a1c1d8f req-a2587bc2-a54b-4116-a527-b75e7ccf2963 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f4aa6bed-3997-41e1-870a-d5e84a1c1d8f req-a2587bc2-a54b-4116-a527-b75e7ccf2963 service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f4aa6bed-3997-41e1-870a-d5e84a1c1d8f req-a2587bc2-a54b-4116-a527-b75e7ccf2963 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f4aa6bed-3997-41e1-870a-d5e84a1c1d8f req-a2587bc2-a54b-4116-a527-b75e7ccf2963 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-f4aa6bed-3997-41e1-870a-d5e84a1c1d8f req-a2587bc2-a54b-4116-a527-b75e7ccf2963 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:11 user nova-compute[72992]: WARNING nova.compute.manager [req-f4aa6bed-3997-41e1-870a-d5e84a1c1d8f req-a2587bc2-a54b-4116-a527-b75e7ccf2963 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received unexpected event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with vm_state building and task_state spawning.
Aug 15 21:35:11 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135311.0846944, 754b808e-e692-42b2-9ab0-fc38e221fb2a => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:35:11 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] VM Started (Lifecycle Event)
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:35:11 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 21:35:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-c7784b2a-fd12-4382-8b35-c15362b2fa2e req-c5f17d7b-67b1-4ada-95a8-2ed482d9247f service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c7784b2a-fd12-4382-8b35-c15362b2fa2e req-c5f17d7b-67b1-4ada-95a8-2ed482d9247f service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c7784b2a-fd12-4382-8b35-c15362b2fa2e req-c5f17d7b-67b1-4ada-95a8-2ed482d9247f service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c7784b2a-fd12-4382-8b35-c15362b2fa2e req-c5f17d7b-67b1-4ada-95a8-2ed482d9247f service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-c7784b2a-fd12-4382-8b35-c15362b2fa2e req-c5f17d7b-67b1-4ada-95a8-2ed482d9247f service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:13 user nova-compute[72992]: WARNING nova.compute.manager [req-c7784b2a-fd12-4382-8b35-c15362b2fa2e req-c5f17d7b-67b1-4ada-95a8-2ed482d9247f service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received unexpected event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with vm_state building and task_state spawning.
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135313.4818525, 7f5d96ae-d869-4100-b3cd-b68eeacdff6e => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:35:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] VM Resumed (Lifecycle Event)
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:35:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance spawned successfully.
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:35:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135313.484565, 7f5d96ae-d869-4100-b3cd-b68eeacdff6e => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:35:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] VM Started (Lifecycle Event)
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:35:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:13 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:35:13 user nova-compute[72992]: INFO nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Took 7.74 seconds to spawn the instance on the hypervisor.
Aug 15 21:35:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:35:13 user nova-compute[72992]: INFO nova.compute.manager [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Took 8.72 seconds to build instance.
Aug 15 21:35:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d77f9d49-0df6-4417-9da5-0ff5b5c8183b tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.880s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:18 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:24 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:35:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:35:28 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=7882MB free_disk=24.707592010498047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Applying migration context for instance 754b808e-e692-42b2-9ab0-fc38e221fb2a as it has an incoming, in-progress migration d98f1af4-ad75-4954-b047-bdd7e79a718d. Migration status is finished {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 21:35:28 user nova-compute[72992]: INFO nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating resource usage from migration d98f1af4-ad75-4954-b047-bdd7e79a718d
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance fcef2646-8b98-472e-96c0-382a6651336e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Migration d98f1af4-ad75-4954-b047-bdd7e79a718d is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 754b808e-e692-42b2-9ab0-fc38e221fb2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:35:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.818s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:35:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:35:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:35:30 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:35:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updating instance_info_cache with network_info: [{"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:35:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-90b1ad6c-0531-4667-82ec-e8b60ed39f32" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:35:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:35:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:35:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:35:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:40 user nova-compute[72992]: INFO nova.compute.manager [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Detaching volume 98d8ff9b-d403-46b2-aca1-567fd9d6bd6d
Aug 15 21:35:40 user nova-compute[72992]: INFO nova.virt.block_device [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Attempting to driver detach volume 98d8ff9b-d403-46b2-aca1-567fd9d6bd6d from mountpoint /dev/vdb
Aug 15 21:35:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Attempting to detach device vdb from instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:35:40 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:35:40 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:35:40 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:35:40 user nova-compute[72992]:   <serial>98d8ff9b-d403-46b2-aca1-567fd9d6bd6d</serial>
Aug 15 21:35:40 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:35:40 user nova-compute[72992]: </disk>
Aug 15 21:35:40 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:35:40 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully detached device vdb from instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 from the persistent domain config.
Aug 15 21:35:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:35:40 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:35:40 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:35:40 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:35:40 user nova-compute[72992]:   <serial>98d8ff9b-d403-46b2-aca1-567fd9d6bd6d</serial>
Aug 15 21:35:40 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:35:40 user nova-compute[72992]: </disk>
Aug 15 21:35:40 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135340.9678621, 90b1ad6c-0531-4667-82ec-e8b60ed39f32 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:35:40 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully detached device vdb from instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32 from the live domain config.
Aug 15 21:35:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeaKANbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:35:40 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:35:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:35:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f3dd62-627f-4980-bffa-f7ceb4315a6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b53b79d-331b-40ca-9f4c-aa0f78fae5bd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:35:41 user nova-compute[72992]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:35:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d (non-flash)
Aug 15 21:35:41 user nova-compute[72992]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:35:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c8851fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[262d2dcd-ea25-4da4-950f-e4746f031434]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc5f08-3a93-4afc-9a07-6bfbd8689a4e]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb10c94-3a83-45fc-9c67-6af14b84ea77]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[af32fa74-abfd-4c9d-8181-5a8368f6f58a]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3389be84-6fd7-4c27-8ca4-33ef665b7440]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdbcebf-f1b4-4f9d-8377-dc02f7f0f11f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260]
Aug 15 21:35:41 user nova-compute[72992]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d, portal: 172.16.0.220,3260] successful.
Aug 15 21:35:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9bdc2-9a87-4ad0-8ff3-9ba57afb3394]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== disconnect_volume: return (263ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:35:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.objects.instance [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'flavor' on Instance uuid 90b1ad6c-0531-4667-82ec-e8b60ed39f32 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bdfa10f9-2c15-4044-9de9-05465a77ba2c tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.930s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.791s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:42 user nova-compute[72992]: INFO nova.compute.manager [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Terminating instance
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-046ed559-97b1-40af-b29c-14f5bc7ed10f req-25b3eb05-7ddd-4bfa-b103-c5820e7cb145 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-vif-unplugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-046ed559-97b1-40af-b29c-14f5bc7ed10f req-25b3eb05-7ddd-4bfa-b103-c5820e7cb145 service nova] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-046ed559-97b1-40af-b29c-14f5bc7ed10f req-25b3eb05-7ddd-4bfa-b103-c5820e7cb145 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-046ed559-97b1-40af-b29c-14f5bc7ed10f req-25b3eb05-7ddd-4bfa-b103-c5820e7cb145 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-046ed559-97b1-40af-b29c-14f5bc7ed10f req-25b3eb05-7ddd-4bfa-b103-c5820e7cb145 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] No waiting events found dispatching network-vif-unplugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-046ed559-97b1-40af-b29c-14f5bc7ed10f req-25b3eb05-7ddd-4bfa-b103-c5820e7cb145 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-vif-unplugged-1fafb4da-a4b9-4e50-bf53-705bb593946a for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:42 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Instance destroyed successfully.
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'resources' on Instance uuid 90b1ad6c-0531-4667-82ec-e8b60ed39f32 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1074417495',display_name='tempest-VolumesSnapshotTestJSON-instance-1074417495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1074417495',id=40,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzefD5Iy54Tcn/k15zEPyf0fWNirTTyySE+GTkWeGe1+ZXByJP+TUr33J4OVYwks6O3706b9FAVfOROUjCG5o32fMfGfE5zRuNLJGoUoFcjUnOuNZZbKfqZmnF98LLwdA==',key_name='tempest-keypair-964395200',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:32:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f905db4444d040d08e517b2c891ba655',ramdisk_id='',reservation_id='r-2430vfce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-815068151',owner_user_name='tempest-VolumesSnapshotTestJSON-815068151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e852f1365e4ac09a88c5c853a1ebd4',uuid=90b1ad6c-0531-4667-82ec-e8b60ed39f32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converting VIF {"id": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "address": "fa:16:3e:2b:61:22", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fafb4da-a4", "ovs_interfaceid": "1fafb4da-a4b9-4e50-bf53-705bb593946a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:61:22,bridge_name='br-int',has_traffic_filtering=True,id=1fafb4da-a4b9-4e50-bf53-705bb593946a,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fafb4da-a4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG os_vif [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:61:22,bridge_name='br-int',has_traffic_filtering=True,id=1fafb4da-a4b9-4e50-bf53-705bb593946a,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fafb4da-a4') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fafb4da-a4, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:35:43 user nova-compute[72992]: INFO os_vif [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:61:22,bridge_name='br-int',has_traffic_filtering=True,id=1fafb4da-a4b9-4e50-bf53-705bb593946a,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fafb4da-a4')
Aug 15 21:35:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeaKANbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:35:43 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d8ff9b-d403-46b2-aca1-567fd9d6bd6d', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27dada9-91e2-4d9b-973a-0f23e644e8cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9b6bb3-94c4-4469-a93e-eb5f52638039]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:35:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:35:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c88433250>, {}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Disconnecting from: [] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== disconnect_volume: return (57ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:35:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Deleting instance files /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32_del
Aug 15 21:35:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Deletion of /opt/stack/data/nova/instances/90b1ad6c-0531-4667-82ec-e8b60ed39f32_del complete
Aug 15 21:35:43 user nova-compute[72992]: INFO nova.compute.manager [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 15 21:35:43 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:35:43 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-6b86ec85-5c7a-4f97-b661-237d3f618066 req-87b37343-8aa8-4faa-bdf9-87f54a97f4a0 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6b86ec85-5c7a-4f97-b661-237d3f618066 req-87b37343-8aa8-4faa-bdf9-87f54a97f4a0 service nova] Acquiring lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6b86ec85-5c7a-4f97-b661-237d3f618066 req-87b37343-8aa8-4faa-bdf9-87f54a97f4a0 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6b86ec85-5c7a-4f97-b661-237d3f618066 req-87b37343-8aa8-4faa-bdf9-87f54a97f4a0 service nova] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-6b86ec85-5c7a-4f97-b661-237d3f618066 req-87b37343-8aa8-4faa-bdf9-87f54a97f4a0 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] No waiting events found dispatching network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:44 user nova-compute[72992]: WARNING nova.compute.manager [req-6b86ec85-5c7a-4f97-b661-237d3f618066 req-87b37343-8aa8-4faa-bdf9-87f54a97f4a0 service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received unexpected event network-vif-plugged-1fafb4da-a4b9-4e50-bf53-705bb593946a for instance with vm_state active and task_state deleting.
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:44 user nova-compute[72992]: INFO nova.compute.manager [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Terminating instance
Aug 15 21:35:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:44 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Took 1.74 seconds to deallocate network for instance.
Aug 15 21:35:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-abe60615-aae4-4787-9726-b6b132522a28 req-f124c3cb-7bc2-488b-8ee2-aaa2ed44fb6b service nova] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Received event network-vif-deleted-1fafb4da-a4b9-4e50-bf53-705bb593946a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:44 user nova-compute[72992]: WARNING nova.volume.cinder [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Attachment e8b3dc80-f4c2-4ec1-afbc-3a1282ec4d6e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e8b3dc80-f4c2-4ec1-afbc-3a1282ec4d6e. (HTTP 404) (Request-ID: req-27fc629c-53a8-4bbf-ab5a-2f4d1d70777f)
Aug 15 21:35:44 user nova-compute[72992]: INFO nova.compute.manager [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Took 0.04 seconds to detach 1 volumes for instance.
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-43acb057-6a74-4830-9380-3fb9c56fdc45 req-5f71033f-190f-40d0-b272-821bb9490036 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-vif-unplugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43acb057-6a74-4830-9380-3fb9c56fdc45 req-5f71033f-190f-40d0-b272-821bb9490036 service nova] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43acb057-6a74-4830-9380-3fb9c56fdc45 req-5f71033f-190f-40d0-b272-821bb9490036 service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-43acb057-6a74-4830-9380-3fb9c56fdc45 req-5f71033f-190f-40d0-b272-821bb9490036 service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-43acb057-6a74-4830-9380-3fb9c56fdc45 req-5f71033f-190f-40d0-b272-821bb9490036 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] No waiting events found dispatching network-vif-unplugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-43acb057-6a74-4830-9380-3fb9c56fdc45 req-5f71033f-190f-40d0-b272-821bb9490036 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-vif-unplugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:45 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Deleted allocations for instance 90b1ad6c-0531-4667-82ec-e8b60ed39f32
Aug 15 21:35:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Instance destroyed successfully.
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.objects.instance [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lazy-loading 'resources' on Instance uuid d3234f5a-b582-45eb-9d1d-605b9c7c0e21 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:27:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-307451061',display_name='tempest-SnapshotDataIntegrityTests-server-307451061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-307451061',id=34,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2krXaJGcGX/l2RLZQHlknrM++XHOruRbnF4rSYLHIROpPtwY9pGGC1zDn1n2W8rVlDU7dVncgjEEGkvJNhF8UeYqs/c4YqBMZK2GZAOG4nILwQB7/vfIhmXw8CoZKZww==',key_name='tempest-keypair-829588425',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:28:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f68f75448b4762a0fa9dfd0a426d14',ramdisk_id='',reservation_id='r-w5j0m0wx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1911350914',owner_user_name='tempest-SnapshotDataIntegrityTests-1911350914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='780eb2549a2f45539251937d0776d0a8',uuid=d3234f5a-b582-45eb-9d1d-605b9c7c0e21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Converting VIF {"id": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "address": "fa:16:3e:75:66:b5", "network": {"id": "592eb26a-e6ee-4427-b55f-17a31bd3a74b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1484748944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f68f75448b4762a0fa9dfd0a426d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape39d6d79-a4", "ovs_interfaceid": "e39d6d79-a4a7-461c-9f11-14be5d7fd5ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=e39d6d79-a4a7-461c-9f11-14be5d7fd5ee,network=Network(592eb26a-e6ee-4427-b55f-17a31bd3a74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d6d79-a4') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG os_vif [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=e39d6d79-a4a7-461c-9f11-14be5d7fd5ee,network=Network(592eb26a-e6ee-4427-b55f-17a31bd3a74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d6d79-a4') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape39d6d79-a4, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8179ce5d-65be-482e-a31f-733d04465d52 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "90b1ad6c-0531-4667-82ec-e8b60ed39f32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.394s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:35:45 user nova-compute[72992]: INFO os_vif [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:66:b5,bridge_name='br-int',has_traffic_filtering=True,id=e39d6d79-a4a7-461c-9f11-14be5d7fd5ee,network=Network(592eb26a-e6ee-4427-b55f-17a31bd3a74b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape39d6d79-a4')
Aug 15 21:35:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Deleting instance files /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21_del
Aug 15 21:35:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Deletion of /opt/stack/data/nova/instances/d3234f5a-b582-45eb-9d1d-605b9c7c0e21_del complete
Aug 15 21:35:45 user nova-compute[72992]: INFO nova.compute.manager [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 21:35:45 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:35:45 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:35:46 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:35:46 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Took 1.05 seconds to deallocate network for instance.
Aug 15 21:35:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-f813f1d1-4e0c-45a1-a405-3814142ee10e req-676f1d99-51b3-45b6-a841-cfe50f08d299 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-vif-deleted-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-122aa9e9-77c2-4447-ae00-9087e8531e5f req-34ab9438-1f1e-4cfb-ade1-276245473567 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received event network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-122aa9e9-77c2-4447-ae00-9087e8531e5f req-34ab9438-1f1e-4cfb-ade1-276245473567 service nova] Acquiring lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-122aa9e9-77c2-4447-ae00-9087e8531e5f req-34ab9438-1f1e-4cfb-ade1-276245473567 service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-122aa9e9-77c2-4447-ae00-9087e8531e5f req-34ab9438-1f1e-4cfb-ade1-276245473567 service nova] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-122aa9e9-77c2-4447-ae00-9087e8531e5f req-34ab9438-1f1e-4cfb-ade1-276245473567 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] No waiting events found dispatching network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:35:47 user nova-compute[72992]: WARNING nova.compute.manager [req-122aa9e9-77c2-4447-ae00-9087e8531e5f req-34ab9438-1f1e-4cfb-ade1-276245473567 service nova] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Received unexpected event network-vif-plugged-e39d6d79-a4a7-461c-9f11-14be5d7fd5ee for instance with vm_state deleted and task_state None.
Aug 15 21:35:47 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Deleted allocations for instance d3234f5a-b582-45eb-9d1d-605b9c7c0e21
Aug 15 21:35:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-d2f25a37-0d94-4491-b712-86848ff80748 tempest-SnapshotDataIntegrityTests-1911350914 tempest-SnapshotDataIntegrityTests-1911350914-project-member] Lock "d3234f5a-b582-45eb-9d1d-605b9c7c0e21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:35:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:35:57 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135342.9712508, 90b1ad6c-0531-4667-82ec-e8b60ed39f32 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:35:57 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] VM Stopped (Lifecycle Event)
Aug 15 21:35:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-33b67152-95b4-4874-9a17-de4ed4119f9c None None] [instance: 90b1ad6c-0531-4667-82ec-e8b60ed39f32] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:36:00 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135345.5660644, d3234f5a-b582-45eb-9d1d-605b9c7c0e21 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:36:00 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] VM Stopped (Lifecycle Event)
Aug 15 21:36:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0c51f765-185f-4028-b5ba-1ca7fd403b13 None None] [instance: d3234f5a-b582-45eb-9d1d-605b9c7c0e21] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:36:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:36:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:36:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:36:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:36:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:18 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:36:19 user nova-compute[72992]: INFO nova.compute.claims [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Claim successful on node user
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:36:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.policy [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdfe815a75424a3187f479d5ff2a0c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdc4df4ef2504da3b4dbdc4205b406a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:36:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Creating image(s)
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "/opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "/opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:19 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk 1073741824" returned: 0 in 0.062s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Successfully created port: 5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.177s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Cannot resize image /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lazy-loading 'migration_context' on Instance uuid a8410b9d-714b-4cf0-8d0f-2d632b5c7052 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Ensure instance console log exists: /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Successfully updated port: 5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquired lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-changed-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Refreshing instance network info cache due to event network-changed-5404be8b-f7ae-4c8c-a0d0-0690a8016513. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] Acquiring lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.neutron [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Updating instance_info_cache with network_info: [{"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Releasing lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Instance network_info: |[{"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] Acquired lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Refreshing network info cache for port 5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Start _get_guest_xml network_info=[{"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:36:21 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:36:21 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1592958886',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1592958886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1592958',id=43,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWF5mgez15re2JlBcVEcknJIzPAibwpbhjJdEuCTGv0HVtXpjgFuz9HgwwCGlPR6+5GCcaxO7ZDn5Ro8qWPeV40duvGQYoXt886cypL8p1hQpjYi3HTM5z0oopiJrzP/g==',key_name='tempest-keypair-1368547830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdc4df4ef2504da3b4dbdc4205b406a3',ramdisk_id='',reservation_id='r-46fmwyze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1482576442',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdfe815a75424a3187f479d5ff2a0c20',uuid=a8410b9d-714b-4cf0-8d0f-2d632b5c7052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Converting VIF {"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:36:53,bridge_name='br-int',has_traffic_filtering=True,id=5404be8b-f7ae-4c8c-a0d0-0690a8016513,network=Network(f531fe15-0aee-4902-ba3b-68a4b5e5b166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5404be8b-f7') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lazy-loading 'pci_devices' on Instance uuid a8410b9d-714b-4cf0-8d0f-2d632b5c7052 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:36:21 user nova-compute[72992]:   <uuid>a8410b9d-714b-4cf0-8d0f-2d632b5c7052</uuid>
Aug 15 21:36:21 user nova-compute[72992]:   <name>instance-0000002b</name>
Aug 15 21:36:21 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:36:21 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:36:21 user nova-compute[72992]:   <metadata>
Aug 15 21:36:21 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:36:21 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:36:21 user nova-compute[72992]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1592958886</nova:name>
Aug 15 21:36:21 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:36:21</nova:creationTime>
Aug 15 21:36:21 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:36:21 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:36:21 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:36:21 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:36:21 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:36:21 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:36:21 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:36:21 user nova-compute[72992]:       <nova:owner>
Aug 15 21:36:21 user nova-compute[72992]:         <nova:user uuid="fdfe815a75424a3187f479d5ff2a0c20">tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member</nova:user>
Aug 15 21:36:21 user nova-compute[72992]:         <nova:project uuid="fdc4df4ef2504da3b4dbdc4205b406a3">tempest-TestServerVolumeAttachScenarioOldVersion-1482576442</nova:project>
Aug 15 21:36:21 user nova-compute[72992]:       </nova:owner>
Aug 15 21:36:21 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:36:21 user nova-compute[72992]:       <nova:ports>
Aug 15 21:36:21 user nova-compute[72992]:         <nova:port uuid="5404be8b-f7ae-4c8c-a0d0-0690a8016513">
Aug 15 21:36:21 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:36:21 user nova-compute[72992]:         </nova:port>
Aug 15 21:36:21 user nova-compute[72992]:       </nova:ports>
Aug 15 21:36:21 user nova-compute[72992]:     </nova:instance>
Aug 15 21:36:21 user nova-compute[72992]:   </metadata>
Aug 15 21:36:21 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:36:21 user nova-compute[72992]:     <system>
Aug 15 21:36:21 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:36:21 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:36:21 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:36:21 user nova-compute[72992]:       <entry name="serial">a8410b9d-714b-4cf0-8d0f-2d632b5c7052</entry>
Aug 15 21:36:21 user nova-compute[72992]:       <entry name="uuid">a8410b9d-714b-4cf0-8d0f-2d632b5c7052</entry>
Aug 15 21:36:21 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:36:21 user nova-compute[72992]:     </system>
Aug 15 21:36:21 user nova-compute[72992]:   </sysinfo>
Aug 15 21:36:21 user nova-compute[72992]:   <os>
Aug 15 21:36:21 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:36:21 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:36:21 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:36:21 user nova-compute[72992]:   </os>
Aug 15 21:36:21 user nova-compute[72992]:   <features>
Aug 15 21:36:21 user nova-compute[72992]:     <acpi/>
Aug 15 21:36:21 user nova-compute[72992]:     <apic/>
Aug 15 21:36:21 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:36:21 user nova-compute[72992]:   </features>
Aug 15 21:36:21 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:36:21 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:36:21 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:36:21 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:36:21 user nova-compute[72992]:   </clock>
Aug 15 21:36:21 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:36:21 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:36:21 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:36:21 user nova-compute[72992]:   </cpu>
Aug 15 21:36:21 user nova-compute[72992]:   <devices>
Aug 15 21:36:21 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:36:21 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:36:21 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk"/>
Aug 15 21:36:21 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:36:21 user nova-compute[72992]:     </disk>
Aug 15 21:36:21 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:36:21 user nova-compute[72992]:       <mac address="fa:16:3e:fc:36:53"/>
Aug 15 21:36:21 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:36:21 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:36:21 user nova-compute[72992]:       <target dev="tap5404be8b-f7"/>
Aug 15 21:36:21 user nova-compute[72992]:     </interface>
Aug 15 21:36:21 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:36:21 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/console.log" append="off"/>
Aug 15 21:36:21 user nova-compute[72992]:     </serial>
Aug 15 21:36:21 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:36:21 user nova-compute[72992]:     <video>
Aug 15 21:36:21 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:36:21 user nova-compute[72992]:     </video>
Aug 15 21:36:21 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:36:21 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:36:21 user nova-compute[72992]:     </rng>
Aug 15 21:36:21 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:36:21 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:36:21 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:36:21 user nova-compute[72992]:     </memballoon>
Aug 15 21:36:21 user nova-compute[72992]:   </devices>
Aug 15 21:36:21 user nova-compute[72992]: </domain>
Aug 15 21:36:21 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1592958886',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1592958886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1592958',id=43,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWF5mgez15re2JlBcVEcknJIzPAibwpbhjJdEuCTGv0HVtXpjgFuz9HgwwCGlPR6+5GCcaxO7ZDn5Ro8qWPeV40duvGQYoXt886cypL8p1hQpjYi3HTM5z0oopiJrzP/g==',key_name='tempest-keypair-1368547830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdc4df4ef2504da3b4dbdc4205b406a3',ramdisk_id='',reservation_id='r-46fmwyze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1482576442',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:36:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdfe815a75424a3187f479d5ff2a0c20',uuid=a8410b9d-714b-4cf0-8d0f-2d632b5c7052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Converting VIF {"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:36:53,bridge_name='br-int',has_traffic_filtering=True,id=5404be8b-f7ae-4c8c-a0d0-0690a8016513,network=Network(f531fe15-0aee-4902-ba3b-68a4b5e5b166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5404be8b-f7') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG os_vif [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:36:53,bridge_name='br-int',has_traffic_filtering=True,id=5404be8b-f7ae-4c8c-a0d0-0690a8016513,network=Network(f531fe15-0aee-4902-ba3b-68a4b5e5b166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5404be8b-f7') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5404be8b-f7, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5404be8b-f7, col_values=(('external_ids', {'iface-id': '5404be8b-f7ae-4c8c-a0d0-0690a8016513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:36:53', 'vm-uuid': 'a8410b9d-714b-4cf0-8d0f-2d632b5c7052'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:21 user nova-compute[72992]: INFO os_vif [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:36:53,bridge_name='br-int',has_traffic_filtering=True,id=5404be8b-f7ae-4c8c-a0d0-0690a8016513,network=Network(f531fe15-0aee-4902-ba3b-68a4b5e5b166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5404be8b-f7')
Aug 15 21:36:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] No VIF found with MAC fa:16:3e:fc:36:53, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Updated VIF entry in instance network info cache for port 5404be8b-f7ae-4c8c-a0d0-0690a8016513. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:36:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Updating instance_info_cache with network_info: [{"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:36:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a7d5884-28a8-4090-a1e9-050da7fec816 req-6a8a8d93-3ed2-4ef0-aec7-c659ed14a702 service nova] Releasing lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:36:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-46376bc1-78f4-4bc7-9e2b-6198ff6d41c8 req-ee65d0b5-84f8-4dff-9f4e-c42aec096b50 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-46376bc1-78f4-4bc7-9e2b-6198ff6d41c8 req-ee65d0b5-84f8-4dff-9f4e-c42aec096b50 service nova] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-46376bc1-78f4-4bc7-9e2b-6198ff6d41c8 req-ee65d0b5-84f8-4dff-9f4e-c42aec096b50 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-46376bc1-78f4-4bc7-9e2b-6198ff6d41c8 req-ee65d0b5-84f8-4dff-9f4e-c42aec096b50 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-46376bc1-78f4-4bc7-9e2b-6198ff6d41c8 req-ee65d0b5-84f8-4dff-9f4e-c42aec096b50 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] No waiting events found dispatching network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:36:23 user nova-compute[72992]: WARNING nova.compute.manager [req-46376bc1-78f4-4bc7-9e2b-6198ff6d41c8 req-ee65d0b5-84f8-4dff-9f4e-c42aec096b50 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received unexpected event network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 for instance with vm_state building and task_state spawning.
Aug 15 21:36:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:24 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135385.0514545, a8410b9d-714b-4cf0-8d0f-2d632b5c7052 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:36:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] VM Resumed (Lifecycle Event)
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:36:25 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Instance spawned successfully.
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:36:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135385.0527844, a8410b9d-714b-4cf0-8d0f-2d632b5c7052 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:36:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] VM Started (Lifecycle Event)
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:36:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:36:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-492f56b4-34cd-4110-a7c4-f116e8f43d38 req-f4ce8928-28b6-4a5a-93a5-c6c0eb30cf80 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-492f56b4-34cd-4110-a7c4-f116e8f43d38 req-f4ce8928-28b6-4a5a-93a5-c6c0eb30cf80 service nova] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-492f56b4-34cd-4110-a7c4-f116e8f43d38 req-f4ce8928-28b6-4a5a-93a5-c6c0eb30cf80 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-492f56b4-34cd-4110-a7c4-f116e8f43d38 req-f4ce8928-28b6-4a5a-93a5-c6c0eb30cf80 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-492f56b4-34cd-4110-a7c4-f116e8f43d38 req-f4ce8928-28b6-4a5a-93a5-c6c0eb30cf80 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] No waiting events found dispatching network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:36:25 user nova-compute[72992]: WARNING nova.compute.manager [req-492f56b4-34cd-4110-a7c4-f116e8f43d38 req-f4ce8928-28b6-4a5a-93a5-c6c0eb30cf80 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received unexpected event network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 for instance with vm_state building and task_state spawning.
Aug 15 21:36:25 user nova-compute[72992]: INFO nova.compute.manager [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Took 6.21 seconds to build instance.
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8057e788-4e1d-4b70-8d8b-0c97a413b396 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.304s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:25 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:36:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:36:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:36:27 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=25.338916778564453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Applying migration context for instance 754b808e-e692-42b2-9ab0-fc38e221fb2a as it has an incoming, in-progress migration d98f1af4-ad75-4954-b047-bdd7e79a718d. Migration status is finished {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 21:36:27 user nova-compute[72992]: INFO nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating resource usage from migration d98f1af4-ad75-4954-b047-bdd7e79a718d
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance fcef2646-8b98-472e-96c0-382a6651336e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Migration d98f1af4-ad75-4954-b047-bdd7e79a718d is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 754b808e-e692-42b2-9ab0-fc38e221fb2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:36:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:36:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:36:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:36:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:36:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:36:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:36:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:36:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:36:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:36:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:32 user nova-compute[72992]: INFO nova.compute.manager [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Terminating instance
Aug 15 21:36:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-6c79e3f5-62a9-41be-b068-214d74623718 req-bf265b3e-1f82-4c45-af15-76636c3ef7d2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-unplugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6c79e3f5-62a9-41be-b068-214d74623718 req-bf265b3e-1f82-4c45-af15-76636c3ef7d2 service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6c79e3f5-62a9-41be-b068-214d74623718 req-bf265b3e-1f82-4c45-af15-76636c3ef7d2 service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-6c79e3f5-62a9-41be-b068-214d74623718 req-bf265b3e-1f82-4c45-af15-76636c3ef7d2 service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-6c79e3f5-62a9-41be-b068-214d74623718 req-bf265b3e-1f82-4c45-af15-76636c3ef7d2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-unplugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:36:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-6c79e3f5-62a9-41be-b068-214d74623718 req-bf265b3e-1f82-4c45-af15-76636c3ef7d2 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-unplugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:36:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Instance destroyed successfully.
Aug 15 21:36:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lazy-loading 'resources' on Instance uuid fcef2646-8b98-472e-96c0-382a6651336e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T21:30:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-742986768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-742986768',id=37,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsCcr6lgBgR97iT2ThwzGJDpTuYJMbWx8hK/iQ+C9IDaA7rPPMVoOhnjETOSWt3k+kMgbWp0oANgIavO6u/iwlVLxGEnXZIZRD9/QQXyvAVftzfj9CEfkRBoxnLlfqzFQ==',key_name='tempest-keypair-1083363969',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:34:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9937b37364574383bb2bee6622aa04c2',ramdisk_id='',reservation_id='r-h8amg216',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1272311701',owner_user_name='tempest-AttachVolumeShelveTestJSON-1272311701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='426fd37dacd64b46b9f8e5d93f052265',uuid=fcef2646-8b98-472e-96c0-382a6651336e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converting VIF {"id": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "address": "fa:16:3e:da:b4:56", "network": {"id": "2304c940-c8f1-49c1-87a4-565c52b2608a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-375423325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9937b37364574383bb2bee6622aa04c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap261cf3d1-ca", "ovs_interfaceid": "261cf3d1-ca1a-4f41-8941-05807eced0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG os_vif [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap261cf3d1-ca, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:36:33 user nova-compute[72992]: INFO os_vif [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:b4:56,bridge_name='br-int',has_traffic_filtering=True,id=261cf3d1-ca1a-4f41-8941-05807eced0fc,network=Network(2304c940-c8f1-49c1-87a4-565c52b2608a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap261cf3d1-ca')
Aug 15 21:36:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Deleting instance files /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e_del
Aug 15 21:36:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Deletion of /opt/stack/data/nova/instances/fcef2646-8b98-472e-96c0-382a6651336e_del complete
Aug 15 21:36:33 user nova-compute[72992]: INFO nova.compute.manager [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Took 0.78 seconds to destroy the instance on the hypervisor.
Aug 15 21:36:33 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:36:33 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:36:34 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Took 1.28 seconds to deallocate network for instance.
Aug 15 21:36:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:34 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Deleted allocations for instance fcef2646-8b98-472e-96c0-382a6651336e
Aug 15 21:36:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-1544e2df-aa7c-47ee-b885-d7f0509716e6 req-2f0bf3c7-2107-4133-8814-d47f5b6b25e5 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1544e2df-aa7c-47ee-b885-d7f0509716e6 req-2f0bf3c7-2107-4133-8814-d47f5b6b25e5 service nova] Acquiring lock "fcef2646-8b98-472e-96c0-382a6651336e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1544e2df-aa7c-47ee-b885-d7f0509716e6 req-2f0bf3c7-2107-4133-8814-d47f5b6b25e5 service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1544e2df-aa7c-47ee-b885-d7f0509716e6 req-2f0bf3c7-2107-4133-8814-d47f5b6b25e5 service nova] Lock "fcef2646-8b98-472e-96c0-382a6651336e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-1544e2df-aa7c-47ee-b885-d7f0509716e6 req-2f0bf3c7-2107-4133-8814-d47f5b6b25e5 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] No waiting events found dispatching network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:36:34 user nova-compute[72992]: WARNING nova.compute.manager [req-1544e2df-aa7c-47ee-b885-d7f0509716e6 req-2f0bf3c7-2107-4133-8814-d47f5b6b25e5 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received unexpected event network-vif-plugged-261cf3d1-ca1a-4f41-8941-05807eced0fc for instance with vm_state deleted and task_state None.
Aug 15 21:36:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-1544e2df-aa7c-47ee-b885-d7f0509716e6 req-2f0bf3c7-2107-4133-8814-d47f5b6b25e5 service nova] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Received event network-vif-deleted-261cf3d1-ca1a-4f41-8941-05807eced0fc {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:36:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-46f68523-c141-46cf-87c8-54611c323e73 tempest-AttachVolumeShelveTestJSON-1272311701 tempest-AttachVolumeShelveTestJSON-1272311701-project-member] Lock "fcef2646-8b98-472e-96c0-382a6651336e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Going to confirm migration 1 {{(pid=72992) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 21:36:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:36:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:36:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:36:39 user nova-compute[72992]: DEBUG nova.objects.instance [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'info_cache' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:36:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG nova.objects.instance [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'migration_context' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:36:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.271s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:40 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Deleted allocation for migration d98f1af4-ad75-4954-b047-bdd7e79a718d
Aug 15 21:36:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f259cb73-53ae-4b3e-8c04-29f8ddd85ee9 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.057s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:47 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135392.940555, fcef2646-8b98-472e-96c0-382a6651336e => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:36:47 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: fcef2646-8b98-472e-96c0-382a6651336e] VM Stopped (Lifecycle Event)
Aug 15 21:36:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a583807f-86bd-4d93-8485-ebf82f96ad59 None None] [instance: fcef2646-8b98-472e-96c0-382a6651336e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:36:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:36:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:59 user nova-compute[72992]: DEBUG nova.objects.instance [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'flavor' on Instance uuid 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:36:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:36:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:36:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:36:59 user nova-compute[72992]: INFO nova.compute.manager [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Attaching volume 964c33ee-9993-447a-8042-d6d575cf67b9 to /dev/vdb
Aug 15 21:37:00 user nova-compute[72992]: DEBUG os_brick.utils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f2be61-249d-49e2-90a6-b13c2304dfaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3353a6-b1a9-4f7c-8ef9-da8d650e932e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23bb26d-43c6-4904-a8d2-90704cec18ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d7131-1c8e-42a1-96b1-e7401de36d81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:37:00 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:37:00 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abdad99-45ef-4712-81b3-6600390a74a2]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG os_brick.utils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:37:00 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating existing volume attachment record: 9d26d59c-fae6-4398-b39b-abef4fb2a38e {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:37:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:37:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:37:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:37:08 user nova-compute[72992]: INFO nova.compute.claims [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Claim successful on node user
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:37:09 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.policy [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78e852f1365e4ac09a88c5c853a1ebd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905db4444d040d08e517b2c891ba655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:37:09 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Creating image(s)
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "/opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "/opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk 1073741824" returned: 0 in 0.055s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Successfully created port: aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.229s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Cannot resize image /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'migration_context' on Instance uuid 4c2d0b56-ba44-4b58-8220-c67e318b8319 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Ensure instance console log exists: /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Successfully updated port: aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquired lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-changed-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.compute.manager [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Refreshing instance network info cache due to event network-changed-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] Acquiring lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Updating instance_info_cache with network_info: [{"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Releasing lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Instance network_info: |[{"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] Acquired lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Refreshing network info cache for port aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Start _get_guest_xml network_info=[{"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:37:11 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:37:11 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-351750067',display_name='tempest-VolumesSnapshotTestJSON-instance-351750067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-351750067',id=44,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeJ50D3RURJwuunN7JD3/vQvv0Q96ONFekm7RHVrlHe83zBkmb30Qvngipgy/aGmsceD+gVUkb4VJsOUXNKF+rdhJckDaXkFqy79VKlFilRhT9dXUb0llxRKNfH7JbFA==',key_name='tempest-keypair-448237384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f905db4444d040d08e517b2c891ba655',ramdisk_id='',reservation_id='r-id9gqe5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815068151',owner_user_name='tempest-VolumesSnapshotTestJSON-815068151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e852f1365e4ac09a88c5c853a1ebd4',uuid=4c2d0b56-ba44-4b58-8220-c67e318b8319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converting VIF {"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ba:bc,bridge_name='br-int',has_traffic_filtering=True,id=aece63e9-ed2f-457c-a3c1-0aa38ac2f39d,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaece63e9-ed') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c2d0b56-ba44-4b58-8220-c67e318b8319 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:37:11 user nova-compute[72992]:   <uuid>4c2d0b56-ba44-4b58-8220-c67e318b8319</uuid>
Aug 15 21:37:11 user nova-compute[72992]:   <name>instance-0000002c</name>
Aug 15 21:37:11 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:37:11 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:37:11 user nova-compute[72992]:   <metadata>
Aug 15 21:37:11 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:37:11 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:37:11 user nova-compute[72992]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-351750067</nova:name>
Aug 15 21:37:11 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:37:11</nova:creationTime>
Aug 15 21:37:11 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:37:11 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:37:11 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:37:11 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:37:11 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:37:11 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:37:11 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:37:11 user nova-compute[72992]:       <nova:owner>
Aug 15 21:37:11 user nova-compute[72992]:         <nova:user uuid="78e852f1365e4ac09a88c5c853a1ebd4">tempest-VolumesSnapshotTestJSON-815068151-project-member</nova:user>
Aug 15 21:37:11 user nova-compute[72992]:         <nova:project uuid="f905db4444d040d08e517b2c891ba655">tempest-VolumesSnapshotTestJSON-815068151</nova:project>
Aug 15 21:37:11 user nova-compute[72992]:       </nova:owner>
Aug 15 21:37:11 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:37:11 user nova-compute[72992]:       <nova:ports>
Aug 15 21:37:11 user nova-compute[72992]:         <nova:port uuid="aece63e9-ed2f-457c-a3c1-0aa38ac2f39d">
Aug 15 21:37:11 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 21:37:11 user nova-compute[72992]:         </nova:port>
Aug 15 21:37:11 user nova-compute[72992]:       </nova:ports>
Aug 15 21:37:11 user nova-compute[72992]:     </nova:instance>
Aug 15 21:37:11 user nova-compute[72992]:   </metadata>
Aug 15 21:37:11 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:37:11 user nova-compute[72992]:     <system>
Aug 15 21:37:11 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:37:11 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:37:11 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:37:11 user nova-compute[72992]:       <entry name="serial">4c2d0b56-ba44-4b58-8220-c67e318b8319</entry>
Aug 15 21:37:11 user nova-compute[72992]:       <entry name="uuid">4c2d0b56-ba44-4b58-8220-c67e318b8319</entry>
Aug 15 21:37:11 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:37:11 user nova-compute[72992]:     </system>
Aug 15 21:37:11 user nova-compute[72992]:   </sysinfo>
Aug 15 21:37:11 user nova-compute[72992]:   <os>
Aug 15 21:37:11 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:37:11 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:37:11 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:37:11 user nova-compute[72992]:   </os>
Aug 15 21:37:11 user nova-compute[72992]:   <features>
Aug 15 21:37:11 user nova-compute[72992]:     <acpi/>
Aug 15 21:37:11 user nova-compute[72992]:     <apic/>
Aug 15 21:37:11 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:37:11 user nova-compute[72992]:   </features>
Aug 15 21:37:11 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:37:11 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:37:11 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:37:11 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:37:11 user nova-compute[72992]:   </clock>
Aug 15 21:37:11 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:37:11 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:37:11 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:37:11 user nova-compute[72992]:   </cpu>
Aug 15 21:37:11 user nova-compute[72992]:   <devices>
Aug 15 21:37:11 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:37:11 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:37:11 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk"/>
Aug 15 21:37:11 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:37:11 user nova-compute[72992]:     </disk>
Aug 15 21:37:11 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:37:11 user nova-compute[72992]:       <mac address="fa:16:3e:58:ba:bc"/>
Aug 15 21:37:11 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:37:11 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:37:11 user nova-compute[72992]:       <target dev="tapaece63e9-ed"/>
Aug 15 21:37:11 user nova-compute[72992]:     </interface>
Aug 15 21:37:11 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:37:11 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/console.log" append="off"/>
Aug 15 21:37:11 user nova-compute[72992]:     </serial>
Aug 15 21:37:11 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:37:11 user nova-compute[72992]:     <video>
Aug 15 21:37:11 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:37:11 user nova-compute[72992]:     </video>
Aug 15 21:37:11 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:37:11 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:37:11 user nova-compute[72992]:     </rng>
Aug 15 21:37:11 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:37:11 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:37:11 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:37:11 user nova-compute[72992]:     </memballoon>
Aug 15 21:37:11 user nova-compute[72992]:   </devices>
Aug 15 21:37:11 user nova-compute[72992]: </domain>
Aug 15 21:37:11 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-351750067',display_name='tempest-VolumesSnapshotTestJSON-instance-351750067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-351750067',id=44,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeJ50D3RURJwuunN7JD3/vQvv0Q96ONFekm7RHVrlHe83zBkmb30Qvngipgy/aGmsceD+gVUkb4VJsOUXNKF+rdhJckDaXkFqy79VKlFilRhT9dXUb0llxRKNfH7JbFA==',key_name='tempest-keypair-448237384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f905db4444d040d08e517b2c891ba655',ramdisk_id='',reservation_id='r-id9gqe5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-815068151',owner_user_name='tempest-VolumesSnapshotTestJSON-815068151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e852f1365e4ac09a88c5c853a1ebd4',uuid=4c2d0b56-ba44-4b58-8220-c67e318b8319,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converting VIF {"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:ba:bc,bridge_name='br-int',has_traffic_filtering=True,id=aece63e9-ed2f-457c-a3c1-0aa38ac2f39d,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaece63e9-ed') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG os_vif [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ba:bc,bridge_name='br-int',has_traffic_filtering=True,id=aece63e9-ed2f-457c-a3c1-0aa38ac2f39d,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaece63e9-ed') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaece63e9-ed, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaece63e9-ed, col_values=(('external_ids', {'iface-id': 'aece63e9-ed2f-457c-a3c1-0aa38ac2f39d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:ba:bc', 'vm-uuid': '4c2d0b56-ba44-4b58-8220-c67e318b8319'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:11 user nova-compute[72992]: INFO os_vif [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:ba:bc,bridge_name='br-int',has_traffic_filtering=True,id=aece63e9-ed2f-457c-a3c1-0aa38ac2f39d,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaece63e9-ed')
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:37:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No VIF found with MAC fa:16:3e:58:ba:bc, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:37:12 user nova-compute[72992]: DEBUG nova.network.neutron [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Updated VIF entry in instance network info cache for port aece63e9-ed2f-457c-a3c1-0aa38ac2f39d. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:37:12 user nova-compute[72992]: DEBUG nova.network.neutron [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Updating instance_info_cache with network_info: [{"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:37:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4febcdd8-7ecf-432d-94b5-b7dc58628136 req-9c4db0a2-efb0-4a39-9484-2f4a1d1b0944 service nova] Releasing lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-00b5e99b-ab05-4b29-80d0-1691e2ac4cec req-f72de28b-d0eb-410d-9b83-5b614793510b service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-00b5e99b-ab05-4b29-80d0-1691e2ac4cec req-f72de28b-d0eb-410d-9b83-5b614793510b service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-00b5e99b-ab05-4b29-80d0-1691e2ac4cec req-f72de28b-d0eb-410d-9b83-5b614793510b service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-00b5e99b-ab05-4b29-80d0-1691e2ac4cec req-f72de28b-d0eb-410d-9b83-5b614793510b service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG nova.compute.manager [req-00b5e99b-ab05-4b29-80d0-1691e2ac4cec req-f72de28b-d0eb-410d-9b83-5b614793510b service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:37:13 user nova-compute[72992]: WARNING nova.compute.manager [req-00b5e99b-ab05-4b29-80d0-1691e2ac4cec req-f72de28b-d0eb-410d-9b83-5b614793510b service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received unexpected event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with vm_state building and task_state spawning.
Aug 15 21:37:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135435.5581381, 4c2d0b56-ba44-4b58-8220-c67e318b8319 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:37:15 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] VM Resumed (Lifecycle Event)
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:37:15 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Instance spawned successfully.
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:37:15 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135435.5594137, 4c2d0b56-ba44-4b58-8220-c67e318b8319 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:37:15 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] VM Started (Lifecycle Event)
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-255be4df-7d22-44af-a7d8-8b39f3791e1b req-08b463eb-0839-40a4-bdf9-109ba76875d5 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-255be4df-7d22-44af-a7d8-8b39f3791e1b req-08b463eb-0839-40a4-bdf9-109ba76875d5 service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-255be4df-7d22-44af-a7d8-8b39f3791e1b req-08b463eb-0839-40a4-bdf9-109ba76875d5 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-255be4df-7d22-44af-a7d8-8b39f3791e1b req-08b463eb-0839-40a4-bdf9-109ba76875d5 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-255be4df-7d22-44af-a7d8-8b39f3791e1b req-08b463eb-0839-40a4-bdf9-109ba76875d5 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:37:15 user nova-compute[72992]: WARNING nova.compute.manager [req-255be4df-7d22-44af-a7d8-8b39f3791e1b req-08b463eb-0839-40a4-bdf9-109ba76875d5 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received unexpected event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with vm_state building and task_state spawning.
Aug 15 21:37:15 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:37:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:15 user nova-compute[72992]: INFO nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 15 21:37:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:37:15 user nova-compute[72992]: INFO nova.compute.manager [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Took 7.49 seconds to build instance.
Aug 15 21:37:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3c385dc3-3049-4f4e-811c-83e4efff7e89 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.594s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtsEoSXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:37:20 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:37:20 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:37:20 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f4d151-f5df-440b-9f0f-4a495c39072b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:37:20 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62fc8f5-1acb-4753-a548-1054df1539c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9] added
Aug 15 21:37:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[78acd722-57a0-49c9-9a6c-290f5525c41d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7124e70-2025-4cb5-b028-3bf632551b0f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtsEoSXl {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtsEoSXl" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4918030b-5c7a-4efd-bbe6-ff1b3f05b434]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KtsEoSXl'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c9b99f-c291-42a5-af59-85b523a55ac4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c7a7f1-5811-4c05-9777-b4666bf1e869]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:37:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:37:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5856aeb1-555f-41b9-be04-3bd2be5f27a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260]
Aug 15 21:37:20 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260] successful.
Aug 15 21:37:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d297f02-3f81-4e7e-8665-13a735873a9d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[953c8454-df7b-4f03-a531-b5afcdb66606]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:37:20 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:37:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:37:20 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:37:20 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d19c559-e815-417f-851c-09cfc9fe719a]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:37:20 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtsEoSXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23965303930326532', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965303930326532', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG nova.objects.instance [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'flavor' on Instance uuid 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:37:21 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:37:21 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:37:21 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:37:21 user nova-compute[72992]:   <serial>964c33ee-9993-447a-8042-d6d575cf67b9</serial>
Aug 15 21:37:21 user nova-compute[72992]: </disk>
Aug 15 21:37:21 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:37:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] No VIF found with MAC fa:16:3e:d9:47:f8, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:37:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-515faecc-7fc3-4072-b059-693f013e3211 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.212s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:22 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing instance network info cache due to event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:37:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:37:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:37:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG nova.network.neutron [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updated VIF entry in instance network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG nova.network.neutron [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e0c206a1-db0a-48b0-8ef1-3e8c9725ac90 req-c36f62b5-c38d-4c14-8ed6-edcae11440f0 service nova] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:37:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing instance network info cache due to event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG nova.network.neutron [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:28 user nova-compute[72992]: INFO nova.compute.manager [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Rebooting instance
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updated VIF entry in instance network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG nova.network.neutron [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:37:28 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:37:28 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:37:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=25.333038330078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8ec5ce77-270c-45a5-93e2-ae17e379370f req-467eb204-3fd0-43b4-a422-de5e69ef4c88 service nova] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:37:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 754b808e-e692-42b2-9ab0-fc38e221fb2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.network.neutron [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:37:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e0710ccf-1252-4d29-9b9c-65d0102e20c3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [{"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e0710ccf-1252-4d29-9b9c-65d0102e20c3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-ee0e72b0-2d63-4f65-b74c-0b5226b55ccf req-d82bf94a-be51-4c69-892e-2c7753d58bcb service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-unplugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ee0e72b0-2d63-4f65-b74c-0b5226b55ccf req-d82bf94a-be51-4c69-892e-2c7753d58bcb service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ee0e72b0-2d63-4f65-b74c-0b5226b55ccf req-d82bf94a-be51-4c69-892e-2c7753d58bcb service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ee0e72b0-2d63-4f65-b74c-0b5226b55ccf req-d82bf94a-be51-4c69-892e-2c7753d58bcb service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-ee0e72b0-2d63-4f65-b74c-0b5226b55ccf req-d82bf94a-be51-4c69-892e-2c7753d58bcb service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-unplugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:37:32 user nova-compute[72992]: WARNING nova.compute.manager [req-ee0e72b0-2d63-4f65-b74c-0b5226b55ccf req-d82bf94a-be51-4c69-892e-2c7753d58bcb service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received unexpected event network-vif-unplugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with vm_state active and task_state reboot_started.
Aug 15 21:37:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance shutdown successfully.
Aug 15 21:37:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-86b43790-917d-4d95-859a-afaee15394dd req-c266b5f8-1e18-44e5-a9b4-74b9aafc5ec7 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-86b43790-917d-4d95-859a-afaee15394dd req-c266b5f8-1e18-44e5-a9b4-74b9aafc5ec7 service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-86b43790-917d-4d95-859a-afaee15394dd req-c266b5f8-1e18-44e5-a9b4-74b9aafc5ec7 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-86b43790-917d-4d95-859a-afaee15394dd req-c266b5f8-1e18-44e5-a9b4-74b9aafc5ec7 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-86b43790-917d-4d95-859a-afaee15394dd req-c266b5f8-1e18-44e5-a9b4-74b9aafc5ec7 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:37:34 user nova-compute[72992]: WARNING nova.compute.manager [req-86b43790-917d-4d95-859a-afaee15394dd req-c266b5f8-1e18-44e5-a9b4-74b9aafc5ec7 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received unexpected event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with vm_state active and task_state reboot_started.
Aug 15 21:37:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:37:36 user nova-compute[72992]: WARNING nova.compute.manager [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received unexpected event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with vm_state active and task_state reboot_started.
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:37:36 user nova-compute[72992]: WARNING nova.compute.manager [req-de64c9e5-3d9f-41ab-b578-0f390924caeb req-1e3c19dd-3de0-4e28-9230-de22d040d1d1 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received unexpected event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with vm_state active and task_state reboot_started.
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Removed pending event for 7f5d96ae-d869-4100-b3cd-b68eeacdff6e due to event {{(pid=72992) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135456.3781147, 7f5d96ae-d869-4100-b3cd-b68eeacdff6e => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:37:36 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] VM Resumed (Lifecycle Event)
Aug 15 21:37:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance running successfully.
Aug 15 21:37:36 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance soft rebooted successfully.
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:37:36 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135456.3803477, 7f5d96ae-d869-4100-b3cd-b68eeacdff6e => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:37:36 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] VM Started (Lifecycle Event)
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-06181813-5468-4a0f-a24f-ebec595a7082 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.218s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:37:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:37:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:37:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-changed-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:38:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Refreshing instance network info cache due to event network-changed-5404be8b-f7ae-4c8c-a0d0-0690a8016513. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:38:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] Acquiring lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:38:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] Acquired lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:38:10 user nova-compute[72992]: DEBUG nova.network.neutron [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Refreshing network info cache for port 5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:38:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Updated VIF entry in instance network info cache for port 5404be8b-f7ae-4c8c-a0d0-0690a8016513. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:38:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Updating instance_info_cache with network_info: [{"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:38:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9d9e8cd0-0bca-4c08-8781-96cf5b7e93ae req-45547cb9-20d7-484e-ba95-7673f77586c1 service nova] Releasing lock "refresh_cache-a8410b9d-714b-4cf0-8d0f-2d632b5c7052" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:38:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lazy-loading 'flavor' on Instance uuid a8410b9d-714b-4cf0-8d0f-2d632b5c7052 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:38:16 user nova-compute[72992]: INFO nova.compute.manager [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Attaching volume e1b332f6-144e-4204-aac6-7ac9bf42d6be to /dev/vdb
Aug 15 21:38:16 user nova-compute[72992]: DEBUG os_brick.utils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[95756ade-0a03-4d2d-9421-eae9b6f376d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7205ea-a19b-491f-b8a7-d58c7b21e365]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4750c9-7128-44c8-a75b-8954dd8887b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4fd10-1eeb-4b07-a7f1-d669d18335eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:38:16 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:38:16 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4488570-6017-489b-b61d-5f7a909e63da]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG os_brick.utils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Updating existing volume attachment record: f627df17-30ee-46a4-b741-4a0a419aecbb {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:38:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:18 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXGdCOIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:38:26 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:38:26 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:38:26 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ba7c2a-4982-4eeb-b741-4d5dfecb7604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:38:26 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7978c2-a8f2-47d3-a091-ba97c16b951d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be] added
Aug 15 21:38:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d909b1-3029-4da5-a9cb-e5b1122b7704]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4052595c-b63c-4473-817b-ec57507486b6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kXGdCOIJ {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kXGdCOIJ" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[185daace-94db-4ce0-8d52-71fecf1493c1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kXGdCOIJ'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[906bb22e-9be6-421e-a389-832d2a4cbd69]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13b0f1-803b-4fad-a0e6-f83a79f34050]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:38:26 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:38:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:38:26 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:38:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b66c59e-6a82-4164-8c6a-9397ca4133bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260]
Aug 15 21:38:26 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260] successful.
Aug 15 21:38:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d552bf-edfe-422d-90ed-17c422e682b0]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[01673111-650c-489f-84cb-5e114560f857]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:38:26 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:38:26 user nova-compute[72992]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be (non-flash)
Aug 15 21:38:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:38:26 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:38:26 user nova-compute[72992]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be (non-flash)
Aug 15 21:38:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8fda60-4d72-42a6-a4f7-1e3f6572614e]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXGdCOIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26463336161633731', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463336161633731', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lazy-loading 'flavor' on Instance uuid a8410b9d-714b-4cf0-8d0f-2d632b5c7052 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:38:27 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:38:27 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:38:27 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:38:27 user nova-compute[72992]:   <serial>e1b332f6-144e-4204-aac6-7ac9bf42d6be</serial>
Aug 15 21:38:27 user nova-compute[72992]: </disk>
Aug 15 21:38:27 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:38:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] No VIF found with MAC fa:16:3e:fc:36:53, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3cb11166-a6ea-429a-87b1-961e8d8ce8ac tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.862s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:38:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:38:30 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:38:30 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8070MB free_disk=25.276592254638672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:38:30 user nova-compute[72992]: INFO nova.compute.manager [None req-be6ea3fa-6d4c-4a00-bc70-31bf796d7c59 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Get console output
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 754b808e-e692-42b2-9ab0-fc38e221fb2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:38:30 user nova-compute[72992]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:38:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:38:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:38:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:38:31 user nova-compute[72992]: INFO nova.compute.manager [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Detaching volume e1b332f6-144e-4204-aac6-7ac9bf42d6be
Aug 15 21:38:31 user nova-compute[72992]: INFO nova.virt.block_device [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Attempting to driver detach volume e1b332f6-144e-4204-aac6-7ac9bf42d6be from mountpoint /dev/vdb
Aug 15 21:38:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Attempting to detach device vdb from instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:38:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:38:31 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:38:31 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:38:31 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:38:31 user nova-compute[72992]:   <serial>e1b332f6-144e-4204-aac6-7ac9bf42d6be</serial>
Aug 15 21:38:31 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:38:31 user nova-compute[72992]: </disk>
Aug 15 21:38:31 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:38:31 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Successfully detached device vdb from instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 from the persistent domain config.
Aug 15 21:38:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:38:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:38:31 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:38:31 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:38:31 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:38:31 user nova-compute[72992]:   <serial>e1b332f6-144e-4204-aac6-7ac9bf42d6be</serial>
Aug 15 21:38:31 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:38:31 user nova-compute[72992]: </disk>
Aug 15 21:38:31 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135512.4362953, a8410b9d-714b-4cf0-8d0f-2d632b5c7052 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:38:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Successfully detached device vdb from instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 from the live domain config.
Aug 15 21:38:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kXGdCOIJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:38:32 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[646018a8-82be-4871-858e-ebefad159c9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e13fee-4458-4de8-84fa-38ec755af478]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:38:32 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:38:32 user nova-compute[72992]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be (non-flash)
Aug 15 21:38:32 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:38:32 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:38:32 user nova-compute[72992]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be (non-flash)
Aug 15 21:38:32 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0cb7b5a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5569e00-fb9c-465f-a8f8-36d5ad9ca5bb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4865e29-70dc-4b53-bb18-0a6687490094]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[767fcd4a-cdbb-4dd4-9bab-61843b91844d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a42bb6-d284-483f-b517-d4cac99ad21b]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[87928463-c2ce-4a42-9c1f-334cc4fdf0b1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4329b4-efc1-422b-ab10-ae32274cd193]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260]
Aug 15 21:38:32 user nova-compute[72992]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be, portal: 172.16.0.220,3260] successful.
Aug 15 21:38:32 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b332f6-144e-4204-aac6-7ac9bf42d6be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772f0f1-668b-40d0-a93e-cd7118f9c911]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] <== disconnect_volume: return (281ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:38:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:33 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [{"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:38:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-754b808e-e692-42b2-9ab0-fc38e221fb2a" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:38:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:38:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:38:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:38:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lazy-loading 'flavor' on Instance uuid a8410b9d-714b-4cf0-8d0f-2d632b5c7052 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:38:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-0069f38a-5060-4ddc-a028-68a2a2413443 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:38:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:38:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:38:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:38:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-changed-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:38:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Refreshing instance network info cache due to event network-changed-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:38:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] Acquiring lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:38:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] Acquired lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:38:59 user nova-compute[72992]: DEBUG nova.network.neutron [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Refreshing network info cache for port aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:39:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Updated VIF entry in instance network info cache for port aece63e9-ed2f-457c-a3c1-0aa38ac2f39d. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:39:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Updating instance_info_cache with network_info: [{"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:39:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-473a362f-0e0b-4c63-9216-d14273161b25 req-83c4aff5-3167-4f30-8a88-cd7d862f517c service nova] Releasing lock "refresh_cache-4c2d0b56-ba44-4b58-8220-c67e318b8319" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:39:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:00 user nova-compute[72992]: DEBUG nova.objects.instance [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'flavor' on Instance uuid 4c2d0b56-ba44-4b58-8220-c67e318b8319 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:39:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Ignoring supplied device name: /dev/vdb
Aug 15 21:39:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:01 user nova-compute[72992]: INFO nova.compute.manager [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Attaching volume 069e6104-274f-4c82-ab4d-82e196248bac to /dev/vdb
Aug 15 21:39:01 user nova-compute[72992]: DEBUG os_brick.utils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[445efdbd-b0e9-4bdf-8a19-66bae5e6c725]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[718bdbac-e3d1-45dc-8341-92c4734fc004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d262d986-7081-4b32-ac07-8233d1e176a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacca703-5b4c-4695-978f-4f6390086908]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:39:01 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:39:01 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f671f057-b64b-49ee-9ed3-ef83e1153d9a]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG os_brick.utils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Updating existing volume attachment record: 74c67f44-0164-4149-97d6-b0b3cf61e85d {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:39:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:39:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMOKCJAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:39:10 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:39:10 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:39:10 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38f58bc-8d0f-4e46-9099-44e4ce54b55e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:39:10 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6b5995-4939-4b63-b5d9-b1897a66dca0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac] added
Aug 15 21:39:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca607a9-61a0-47b0-8ce6-d5d936078034]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[65edae43-5f7e-4872-b995-ddc9bbb3fd91]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMOKCJAy {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMOKCJAy" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e62c0-5eac-4e74-9f92-c4640f9f9b21]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMOKCJAy'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[43041ca7-8a0f-41ea-9ed8-dcb2be3ae3d8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9b33c1-7570-4380-a79e-a90d295a250b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:10 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:39:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:10 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:39:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8108f06e-70e3-4e78-858f-bcbff6d519a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260]
Aug 15 21:39:10 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260] successful.
Aug 15 21:39:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b88a3c7-f185-4132-b3e7-49ed530dd993]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c376ec02-b7f8-4773-a616-ffba44e99163]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:10 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:39:10 user nova-compute[72992]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:10 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:39:10 user nova-compute[72992]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed0b433-b4bb-4093-8fc1-7e6ced35bbf1]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMOKCJAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23966646138326436', 'path': '/dev/sdd'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966646138326436', 'path': '/dev/sdd'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG nova.objects.instance [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'flavor' on Instance uuid 4c2d0b56-ba44-4b58-8220-c67e318b8319 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:39:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:39:11 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:39:11 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:39:11 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:39:11 user nova-compute[72992]:   <serial>069e6104-274f-4c82-ab4d-82e196248bac</serial>
Aug 15 21:39:11 user nova-compute[72992]: </disk>
Aug 15 21:39:11 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:39:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:39:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:39:12 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] No VIF found with MAC fa:16:3e:58:ba:bc, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:39:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fbe1ed01-f811-4d73-951e-31973109181b tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.361s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:15 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing instance network info cache due to event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:39:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:39:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:39:20 user nova-compute[72992]: DEBUG nova.network.neutron [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updated VIF entry in instance network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7a74371b-650c-4323-951a-a3617fe382f2 req-47b01a7e-71a4-4365-b925-41f9b2a607dc service nova] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing instance network info cache due to event network-changed-f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Refreshing network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:21 user nova-compute[72992]: INFO nova.compute.manager [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Detaching volume 964c33ee-9993-447a-8042-d6d575cf67b9
Aug 15 21:39:21 user nova-compute[72992]: INFO nova.virt.block_device [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Attempting to driver detach volume 964c33ee-9993-447a-8042-d6d575cf67b9 from mountpoint /dev/vdb
Aug 15 21:39:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Attempting to detach device vdb from instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:39:21 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:39:21 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:39:21 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:39:21 user nova-compute[72992]:   <serial>964c33ee-9993-447a-8042-d6d575cf67b9</serial>
Aug 15 21:39:21 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:39:21 user nova-compute[72992]: </disk>
Aug 15 21:39:21 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:39:21 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully detached device vdb from instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e from the persistent domain config.
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:39:21 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:39:21 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:39:21 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:39:21 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:39:21 user nova-compute[72992]:   <serial>964c33ee-9993-447a-8042-d6d575cf67b9</serial>
Aug 15 21:39:21 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:39:21 user nova-compute[72992]: </disk>
Aug 15 21:39:21 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG nova.network.neutron [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updated VIF entry in instance network info cache for port f9e74969-4101-4a49-a2f4-e77b297f993c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG nova.network.neutron [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2987b19-4365-42fe-83c9-d71cd9fb7130 req-34e86faa-da0e-4900-804b-231a8269d2a3 service nova] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135562.3373826, 7f5d96ae-d869-4100-b3cd-b68eeacdff6e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:39:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully detached device vdb from instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e from the live domain config.
Aug 15 21:39:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtsEoSXl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:39:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff9699-d872-4b0e-b456-8736744729f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fda6f5-8e29-49db-8b1d-d177e085498c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:22 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:39:22 user nova-compute[72992]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:22 user nova-compute[72992]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 (non-flash)
Aug 15 21:39:22 user nova-compute[72992]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c885af2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be42a72-a5c6-4aba-b81a-df61cd9b1a08]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1d715f-ccf7-405b-afa6-69ba0a3ea9c2]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb406aff-947a-451e-8b40-ec6eb1cc0909]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a63384b-2e79-4e26-94ed-b952eabc079d]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[72839b85-6861-45ce-ba64-6829374cc240]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dccdbd3-9edf-4a5d-b8a0-4e74f86743c0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260]
Aug 15 21:39:22 user nova-compute[72992]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9, portal: 172.16.0.220,3260] successful.
Aug 15 21:39:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:964c33ee-9993-447a-8042-d6d575cf67b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b765c3f-bb33-411c-a61a-95a82eaf554d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] <== disconnect_volume: return (293ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:39:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:23 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'flavor' on Instance uuid 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:39:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28428370-7072-44e5-bb60-dfaa14a84c06 tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:27 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:39:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:28 user nova-compute[72992]: INFO nova.compute.manager [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Terminating instance
Aug 15 21:39:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-7b1c4812-7b25-434d-acc9-cfd54d7683b5 req-ebdd6d69-852b-44a0-b890-7f467faa6341 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-vif-unplugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7b1c4812-7b25-434d-acc9-cfd54d7683b5 req-ebdd6d69-852b-44a0-b890-7f467faa6341 service nova] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7b1c4812-7b25-434d-acc9-cfd54d7683b5 req-ebdd6d69-852b-44a0-b890-7f467faa6341 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7b1c4812-7b25-434d-acc9-cfd54d7683b5 req-ebdd6d69-852b-44a0-b890-7f467faa6341 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-7b1c4812-7b25-434d-acc9-cfd54d7683b5 req-ebdd6d69-852b-44a0-b890-7f467faa6341 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] No waiting events found dispatching network-vif-unplugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-7b1c4812-7b25-434d-acc9-cfd54d7683b5 req-ebdd6d69-852b-44a0-b890-7f467faa6341 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-vif-unplugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Instance destroyed successfully.
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lazy-loading 'resources' on Instance uuid a8410b9d-714b-4cf0-8d0f-2d632b5c7052 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:36:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1592958886',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1592958886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1592958',id=43,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWF5mgez15re2JlBcVEcknJIzPAibwpbhjJdEuCTGv0HVtXpjgFuz9HgwwCGlPR6+5GCcaxO7ZDn5Ro8qWPeV40duvGQYoXt886cypL8p1hQpjYi3HTM5z0oopiJrzP/g==',key_name='tempest-keypair-1368547830',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdc4df4ef2504da3b4dbdc4205b406a3',ramdisk_id='',reservation_id='r-46fmwyze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1482576442',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdfe815a75424a3187f479d5ff2a0c20',uuid=a8410b9d-714b-4cf0-8d0f-2d632b5c7052,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Converting VIF {"id": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "address": "fa:16:3e:fc:36:53", "network": {"id": "f531fe15-0aee-4902-ba3b-68a4b5e5b166", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-909199780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdc4df4ef2504da3b4dbdc4205b406a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5404be8b-f7", "ovs_interfaceid": "5404be8b-f7ae-4c8c-a0d0-0690a8016513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:36:53,bridge_name='br-int',has_traffic_filtering=True,id=5404be8b-f7ae-4c8c-a0d0-0690a8016513,network=Network(f531fe15-0aee-4902-ba3b-68a4b5e5b166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5404be8b-f7') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG os_vif [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:36:53,bridge_name='br-int',has_traffic_filtering=True,id=5404be8b-f7ae-4c8c-a0d0-0690a8016513,network=Network(f531fe15-0aee-4902-ba3b-68a4b5e5b166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5404be8b-f7') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5404be8b-f7, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:39:29 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:39:29 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8269MB free_disk=25.273479461669922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:29 user nova-compute[72992]: INFO os_vif [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:36:53,bridge_name='br-int',has_traffic_filtering=True,id=5404be8b-f7ae-4c8c-a0d0-0690a8016513,network=Network(f531fe15-0aee-4902-ba3b-68a4b5e5b166),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5404be8b-f7')
Aug 15 21:39:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Deleting instance files /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052_del
Aug 15 21:39:29 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Deletion of /opt/stack/data/nova/instances/a8410b9d-714b-4cf0-8d0f-2d632b5c7052_del complete
Aug 15 21:39:29 user nova-compute[72992]: INFO nova.compute.manager [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 15 21:39:29 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:39:29 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 754b808e-e692-42b2-9ab0-fc38e221fb2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:39:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:31 user nova-compute[72992]: INFO nova.compute.manager [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Terminating instance
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-b5bb7032-ec81-4ac6-b774-13a5f1069dce req-a08a892a-46a2-4bd8-a105-afb98be46de7 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b5bb7032-ec81-4ac6-b774-13a5f1069dce req-a08a892a-46a2-4bd8-a105-afb98be46de7 service nova] Acquiring lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b5bb7032-ec81-4ac6-b774-13a5f1069dce req-a08a892a-46a2-4bd8-a105-afb98be46de7 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b5bb7032-ec81-4ac6-b774-13a5f1069dce req-a08a892a-46a2-4bd8-a105-afb98be46de7 service nova] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-b5bb7032-ec81-4ac6-b774-13a5f1069dce req-a08a892a-46a2-4bd8-a105-afb98be46de7 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] No waiting events found dispatching network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:31 user nova-compute[72992]: WARNING nova.compute.manager [req-b5bb7032-ec81-4ac6-b774-13a5f1069dce req-a08a892a-46a2-4bd8-a105-afb98be46de7 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received unexpected event network-vif-plugged-5404be8b-f7ae-4c8c-a0d0-0690a8016513 for instance with vm_state active and task_state deleting.
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-f59d2d79-0a02-412f-a375-34aff9fc792c req-0f45f85e-ca1f-4b67-983c-3b9f3d9aa839 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-unplugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f59d2d79-0a02-412f-a375-34aff9fc792c req-0f45f85e-ca1f-4b67-983c-3b9f3d9aa839 service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f59d2d79-0a02-412f-a375-34aff9fc792c req-0f45f85e-ca1f-4b67-983c-3b9f3d9aa839 service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f59d2d79-0a02-412f-a375-34aff9fc792c req-0f45f85e-ca1f-4b67-983c-3b9f3d9aa839 service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-f59d2d79-0a02-412f-a375-34aff9fc792c req-0f45f85e-ca1f-4b67-983c-3b9f3d9aa839 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-unplugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.compute.manager [req-f59d2d79-0a02-412f-a375-34aff9fc792c req-0f45f85e-ca1f-4b67-983c-3b9f3d9aa839 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-unplugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:39:31 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Took 1.79 seconds to deallocate network for instance.
Aug 15 21:39:31 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Instance destroyed successfully.
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.objects.instance [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'resources' on Instance uuid 754b808e-e692-42b2-9ab0-fc38e221fb2a {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:32:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-936163427',display_name='tempest-ServerActionsTestOtherA-server-936163427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-936163427',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:35:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-t1d00ezo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:36:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=754b808e-e692-42b2-9ab0-fc38e221fb2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "address": "fa:16:3e:34:08:6f", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13eb4425-57", "ovs_interfaceid": "13eb4425-57ab-4c0c-b0dd-f81b789ddc1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_vif [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13eb4425-57, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:31 user nova-compute[72992]: INFO os_vif [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:6f,bridge_name='br-int',has_traffic_filtering=True,id=13eb4425-57ab-4c0c-b0dd-f81b789ddc1e,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13eb4425-57')
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRgyYixr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:39:31 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a67f0ba-059d-4e25-8776-e44f0758f7a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[570510c3-f269-437f-b50d-53ab9fede2ea]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:31 user nova-compute[72992]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf (non-flash)
Aug 15 21:39:31 user nova-compute[72992]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:31 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64d7f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:39:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d14c7-2461-432c-8df1-5a4c456e6376]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3e5e90-9dc0-442e-a7fe-301ab34bf573]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[551d9a0c-5e1d-4d84-b3d1-2c43f8e5ca67]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[487d199d-618d-4899-8ffe-97be247c9dc0]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2808fe-b70a-4336-b4bb-6fe3cc927fd7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd6900f-ddd5-4d1e-8111-48058cadcc3d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260]
Aug 15 21:39:32 user nova-compute[72992]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf, portal: 172.16.0.220,3260] successful.
Aug 15 21:39:32 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d51d7980-48d7-4f6d-9da7-07527f156eaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e71a849-1b5d-44e2-9463-df03c18c6720]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] <== disconnect_volume: return (416ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:39:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Deleting instance files /opt/stack/data/nova/instances/754b808e-e692-42b2-9ab0-fc38e221fb2a_del
Aug 15 21:39:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Deletion of /opt/stack/data/nova/instances/754b808e-e692-42b2-9ab0-fc38e221fb2a_del complete
Aug 15 21:39:32 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Deleted allocations for instance a8410b9d-714b-4cf0-8d0f-2d632b5c7052
Aug 15 21:39:32 user nova-compute[72992]: INFO nova.compute.manager [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-da90279a-191d-4a8e-8c7e-919af091f805 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442 tempest-TestServerVolumeAttachScenarioOldVersion-1482576442-project-member] Lock "a8410b9d-714b-4cf0-8d0f-2d632b5c7052" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.774s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [{"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-7f5d96ae-d869-4100-b3cd-b68eeacdff6e" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:39:33 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:39:33 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Took 1.18 seconds to deallocate network for instance.
Aug 15 21:39:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Received event network-vif-deleted-5404be8b-f7ae-4c8c-a0d0-0690a8016513 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] Acquiring lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] No waiting events found dispatching network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:33 user nova-compute[72992]: WARNING nova.compute.manager [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received unexpected event network-vif-plugged-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e for instance with vm_state active and task_state deleting.
Aug 15 21:39:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-99393ba4-c89d-4879-87aa-769cc2d037de req-9cd9b5d7-71a1-4ca0-8f4e-249c1c417f17 service nova] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Received event network-vif-deleted-13eb4425-57ab-4c0c-b0dd-f81b789ddc1e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:34 user nova-compute[72992]: INFO nova.compute.manager [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 21:39:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Deleting volume: d51d7980-48d7-4f6d-9da7-07527f156eaf {{(pid=72992) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 21:39:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:34 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:39:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:39:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:34 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Deleted allocations for instance 754b808e-e692-42b2-9ab0-fc38e221fb2a
Aug 15 21:39:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-1c585f73-34ed-4725-92e9-088773e5e706 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "754b808e-e692-42b2-9ab0-fc38e221fb2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.678s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:39:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:39:44 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135569.4944417, a8410b9d-714b-4cf0-8d0f-2d632b5c7052 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:39:44 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] VM Stopped (Lifecycle Event)
Aug 15 21:39:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-347dc0cf-f8db-4fc6-9e37-f94b49d9d974 None None] [instance: a8410b9d-714b-4cf0-8d0f-2d632b5c7052] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:39:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:45 user nova-compute[72992]: INFO nova.compute.manager [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Detaching volume 069e6104-274f-4c82-ab4d-82e196248bac
Aug 15 21:39:45 user nova-compute[72992]: INFO nova.virt.block_device [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Attempting to driver detach volume 069e6104-274f-4c82-ab4d-82e196248bac from mountpoint /dev/vdb
Aug 15 21:39:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Attempting to detach device vdb from instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:39:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:39:45 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:39:45 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:39:45 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:39:45 user nova-compute[72992]:   <serial>069e6104-274f-4c82-ab4d-82e196248bac</serial>
Aug 15 21:39:45 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:39:45 user nova-compute[72992]: </disk>
Aug 15 21:39:45 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:39:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully detached device vdb from instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 from the persistent domain config.
Aug 15 21:39:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:39:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:39:45 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:39:45 user nova-compute[72992]:   <source dev="/dev/sdd"/>
Aug 15 21:39:45 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:39:45 user nova-compute[72992]:   <serial>069e6104-274f-4c82-ab4d-82e196248bac</serial>
Aug 15 21:39:45 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:39:45 user nova-compute[72992]: </disk>
Aug 15 21:39:45 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135586.4312491, 4c2d0b56-ba44-4b58-8220-c67e318b8319 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:39:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully detached device vdb from instance 4c2d0b56-ba44-4b58-8220-c67e318b8319 from the live domain config.
Aug 15 21:39:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMOKCJAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:39:46 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e9054e-32a2-4bd3-a640-474217292c31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b164ae37-4389-4536-bcfd-bf5c42ea03be]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:46 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac (non-flash)
Aug 15 21:39:46 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c7e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac'): ({'sdd'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Removing single pathed devices sdd {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b9993c-c8bb-41f8-b369-e6ba2b33a4e0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[89880918-6366-47bc-8a49-e9a287d82c1c]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Flushing IO for device /dev/sdd {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2a83b-0afb-4379-97f6-2bbf4de8c106]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c44ac8f-c5e0-45d0-83b4-7a233f57f4e9]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] SCSI volumes sdd have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[245293e7-6559-4037-b0c9-e7efe6f1e7fe]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c545f9d-e5dd-4387-a596-bcd1ecf81669]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260]
Aug 15 21:39:46 user nova-compute[72992]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac, portal: 172.16.0.220,3260] successful.
Aug 15 21:39:46 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8a17f-7949-46ac-9db8-9d876fe49fa1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.243s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== disconnect_volume: return (245ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135571.855276, 754b808e-e692-42b2-9ab0-fc38e221fb2a => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:39:46 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] VM Stopped (Lifecycle Event)
Aug 15 21:39:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b7bf696f-b56b-4dad-9959-37bdf425588d None None] [instance: 754b808e-e692-42b2-9ab0-fc38e221fb2a] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:39:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'flavor' on Instance uuid 4c2d0b56-ba44-4b58-8220-c67e318b8319 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5eb90d8-2e58-48ab-9f8e-58654aae0d0e tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.894s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.787s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:47 user nova-compute[72992]: INFO nova.compute.manager [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Terminating instance
Aug 15 21:39:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-998201bb-54ed-4333-a7f8-8c54e78c7de4 req-a91e56d1-b86d-4c6b-ba99-19963760f8ae service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-unplugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-998201bb-54ed-4333-a7f8-8c54e78c7de4 req-a91e56d1-b86d-4c6b-ba99-19963760f8ae service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-998201bb-54ed-4333-a7f8-8c54e78c7de4 req-a91e56d1-b86d-4c6b-ba99-19963760f8ae service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-998201bb-54ed-4333-a7f8-8c54e78c7de4 req-a91e56d1-b86d-4c6b-ba99-19963760f8ae service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-998201bb-54ed-4333-a7f8-8c54e78c7de4 req-a91e56d1-b86d-4c6b-ba99-19963760f8ae service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-unplugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:47 user nova-compute[72992]: DEBUG nova.compute.manager [req-998201bb-54ed-4333-a7f8-8c54e78c7de4 req-a91e56d1-b86d-4c6b-ba99-19963760f8ae service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-unplugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Instance destroyed successfully.
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lazy-loading 'resources' on Instance uuid 4c2d0b56-ba44-4b58-8220-c67e318b8319 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-351750067',display_name='tempest-VolumesSnapshotTestJSON-instance-351750067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-351750067',id=44,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPeJ50D3RURJwuunN7JD3/vQvv0Q96ONFekm7RHVrlHe83zBkmb30Qvngipgy/aGmsceD+gVUkb4VJsOUXNKF+rdhJckDaXkFqy79VKlFilRhT9dXUb0llxRKNfH7JbFA==',key_name='tempest-keypair-448237384',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f905db4444d040d08e517b2c891ba655',ramdisk_id='',reservation_id='r-id9gqe5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-815068151',owner_user_name='tempest-VolumesSnapshotTestJSON-815068151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78e852f1365e4ac09a88c5c853a1ebd4',uuid=4c2d0b56-ba44-4b58-8220-c67e318b8319,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converting VIF {"id": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "address": "fa:16:3e:58:ba:bc", "network": {"id": "c2b46f7b-d806-4f01-95b4-daec9062a740", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-455058796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f905db4444d040d08e517b2c891ba655", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaece63e9-ed", "ovs_interfaceid": "aece63e9-ed2f-457c-a3c1-0aa38ac2f39d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:ba:bc,bridge_name='br-int',has_traffic_filtering=True,id=aece63e9-ed2f-457c-a3c1-0aa38ac2f39d,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaece63e9-ed') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_vif [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:ba:bc,bridge_name='br-int',has_traffic_filtering=True,id=aece63e9-ed2f-457c-a3c1-0aa38ac2f39d,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaece63e9-ed') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaece63e9-ed, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:48 user nova-compute[72992]: INFO os_vif [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:ba:bc,bridge_name='br-int',has_traffic_filtering=True,id=aece63e9-ed2f-457c-a3c1-0aa38ac2f39d,network=Network(c2b46f7b-d806-4f01-95b4-daec9062a740),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaece63e9-ed')
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMOKCJAy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:39:48 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069e6104-274f-4c82-ab4d-82e196248bac', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f77c49-29c4-40f5-a266-e287d8e0552b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:48 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 15 21:39:48 user nova-compute[72992]: 
Aug 15 21:39:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c85c65-dba0-413d-974b-6c5f78272b9e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:39:48 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:39:48 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:39:48 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:39:48 user nova-compute[72992]: 
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c884a40d0>, {}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Disconnecting from: [] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] <== disconnect_volume: return (50ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:39:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Deleting instance files /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319_del
Aug 15 21:39:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Deletion of /opt/stack/data/nova/instances/4c2d0b56-ba44-4b58-8220-c67e318b8319_del complete
Aug 15 21:39:48 user nova-compute[72992]: INFO nova.compute.manager [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 21:39:48 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:39:48 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:39:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:49 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:39:49 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Took 1.17 seconds to deallocate network for instance.
Aug 15 21:39:49 user nova-compute[72992]: WARNING nova.volume.cinder [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Attachment 74c67f44-0164-4149-97d6-b0b3cf61e85d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 74c67f44-0164-4149-97d6-b0b3cf61e85d. (HTTP 404) (Request-ID: req-98768a4c-b8f6-4711-84b4-f048908cdc95)
Aug 15 21:39:49 user nova-compute[72992]: INFO nova.compute.manager [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Took 0.02 seconds to detach 1 volumes for instance.
Aug 15 21:39:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:50 user nova-compute[72992]: WARNING nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received unexpected event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with vm_state deleted and task_state None.
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:50 user nova-compute[72992]: WARNING nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received unexpected event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with vm_state deleted and task_state None.
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:50 user nova-compute[72992]: WARNING nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received unexpected event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with vm_state deleted and task_state None.
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-unplugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-unplugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:50 user nova-compute[72992]: WARNING nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received unexpected event network-vif-unplugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with vm_state deleted and task_state None.
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Acquiring lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] No waiting events found dispatching network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:39:50 user nova-compute[72992]: WARNING nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received unexpected event network-vif-plugged-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d for instance with vm_state deleted and task_state None.
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.manager [req-360eab21-f55f-436e-8a7b-567a1c9a40ff req-584b9814-db99-4588-8076-0f58688f3f07 service nova] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Received event network-vif-deleted-aece63e9-ed2f-457c-a3c1-0aa38ac2f39d {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:50 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Deleted allocations for instance 4c2d0b56-ba44-4b58-8220-c67e318b8319
Aug 15 21:39:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aa71c1e0-3d5c-47cf-963c-5ef8f3fc5842 tempest-VolumesSnapshotTestJSON-815068151 tempest-VolumesSnapshotTestJSON-815068151-project-member] Lock "4c2d0b56-ba44-4b58-8220-c67e318b8319" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.616s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:39:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:39:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:39:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:39:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:39:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:39:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:39:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:39:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135588.49165, 4c2d0b56-ba44-4b58-8220-c67e318b8319 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:40:03 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] VM Stopped (Lifecycle Event)
Aug 15 21:40:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b398d519-8c56-4285-b08d-ee7d9aa20acf None None] [instance: 4c2d0b56-ba44-4b58-8220-c67e318b8319] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid e0710ccf-1252-4d29-9b9c-65d0102e20c3 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:40:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:17 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:18 user nova-compute[72992]: INFO nova.compute.manager [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Terminating instance
Aug 15 21:40:18 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-fb47d886-d910-4aa3-99eb-5722ad62d8be req-f82f8f16-6c6d-4790-ae06-a0faf34225f7 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-unplugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fb47d886-d910-4aa3-99eb-5722ad62d8be req-f82f8f16-6c6d-4790-ae06-a0faf34225f7 service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fb47d886-d910-4aa3-99eb-5722ad62d8be req-f82f8f16-6c6d-4790-ae06-a0faf34225f7 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fb47d886-d910-4aa3-99eb-5722ad62d8be req-f82f8f16-6c6d-4790-ae06-a0faf34225f7 service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-fb47d886-d910-4aa3-99eb-5722ad62d8be req-f82f8f16-6c6d-4790-ae06-a0faf34225f7 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-unplugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-fb47d886-d910-4aa3-99eb-5722ad62d8be req-f82f8f16-6c6d-4790-ae06-a0faf34225f7 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-unplugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:40:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Instance destroyed successfully.
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lazy-loading 'resources' on Instance uuid 7f5d96ae-d869-4100-b3cd-b68eeacdff6e {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:35:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1789099430',display_name='tempest-TestMinimumBasicScenario-server-1789099430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1789099430',id=42,image_ref='30b7e569-63f4-4e80-93b6-8b07a1ee621a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/4OTpWU49MyvicFQEg0z/coi/FTVr2MzPNTwQZYwd7AKyJE7eBqHX4ErvicJQupcTG0QBYHv+Mt5e4+2M4hjeMo0fzZmTQF0IvhOm1QFN8ISOpUrki8q/I/cY/3UlQPQ==',key_name='tempest-TestMinimumBasicScenario-1732605881',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='626d22c8835e4819aadcf9cbe0180dc1',ramdisk_id='',reservation_id='r-oznuxq7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='30b7e569-63f4-4e80-93b6-8b07a1ee621a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-543863856',owner_user_name='tempest-TestMinimumBasicScenario-543863856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:37:36Z,user_data=None,user_id='478df679862f4c3a9887beb0fd2518c7',uuid=7f5d96ae-d869-4100-b3cd-b68eeacdff6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converting VIF {"id": "f9e74969-4101-4a49-a2f4-e77b297f993c", "address": "fa:16:3e:d9:47:f8", "network": {"id": "3cdc98cf-0d9c-4bc3-8b9e-edf077487406", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1598582379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "626d22c8835e4819aadcf9cbe0180dc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e74969-41", "ovs_interfaceid": "f9e74969-4101-4a49-a2f4-e77b297f993c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:47:f8,bridge_name='br-int',has_traffic_filtering=True,id=f9e74969-4101-4a49-a2f4-e77b297f993c,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e74969-41') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG os_vif [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:47:f8,bridge_name='br-int',has_traffic_filtering=True,id=f9e74969-4101-4a49-a2f4-e77b297f993c,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e74969-41') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9e74969-41, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:19 user nova-compute[72992]: INFO os_vif [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:47:f8,bridge_name='br-int',has_traffic_filtering=True,id=f9e74969-4101-4a49-a2f4-e77b297f993c,network=Network(3cdc98cf-0d9c-4bc3-8b9e-edf077487406),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e74969-41')
Aug 15 21:40:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Deleting instance files /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e_del
Aug 15 21:40:19 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Deletion of /opt/stack/data/nova/instances/7f5d96ae-d869-4100-b3cd-b68eeacdff6e_del complete
Aug 15 21:40:19 user nova-compute[72992]: INFO nova.compute.manager [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 21:40:19 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:40:19 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:40:20 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:40:20 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Took 0.92 seconds to deallocate network for instance.
Aug 15 21:40:20 user nova-compute[72992]: DEBUG nova.compute.manager [req-59afe8b5-4411-47cf-a040-89e0f0cb2f76 req-5fa593a2-8b35-41f0-b2c4-7f4d91a5fb85 service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-deleted-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:40:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:20 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:40:20 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:40:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:20 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Deleted allocations for instance 7f5d96ae-d869-4100-b3cd-b68eeacdff6e
Aug 15 21:40:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a4a1791-569d-43aa-bf26-dd01577a053f tempest-TestMinimumBasicScenario-543863856 tempest-TestMinimumBasicScenario-543863856-project-member] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-b444c342-3722-44ef-9353-5e64e19fbded req-9553fd9e-d968-4f66-a790-4a1c109226cd service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:40:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b444c342-3722-44ef-9353-5e64e19fbded req-9553fd9e-d968-4f66-a790-4a1c109226cd service nova] Acquiring lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b444c342-3722-44ef-9353-5e64e19fbded req-9553fd9e-d968-4f66-a790-4a1c109226cd service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b444c342-3722-44ef-9353-5e64e19fbded req-9553fd9e-d968-4f66-a790-4a1c109226cd service nova] Lock "7f5d96ae-d869-4100-b3cd-b68eeacdff6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-b444c342-3722-44ef-9353-5e64e19fbded req-9553fd9e-d968-4f66-a790-4a1c109226cd service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] No waiting events found dispatching network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:40:21 user nova-compute[72992]: WARNING nova.compute.manager [req-b444c342-3722-44ef-9353-5e64e19fbded req-9553fd9e-d968-4f66-a790-4a1c109226cd service nova] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Received unexpected event network-vif-plugged-f9e74969-4101-4a49-a2f4-e77b297f993c for instance with vm_state deleted and task_state None.
Aug 15 21:40:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:40:28 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:29 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:40:29 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:40:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8632MB free_disk=25.34621810913086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0710ccf-1252-4d29-9b9c-65d0102e20c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:40:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:40:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:33 user nova-compute[72992]: INFO nova.compute.manager [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Terminating instance
Aug 15 21:40:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-7dd00392-5b4d-4ce8-8a23-d7a294cf453f req-683d3260-7afa-4925-9da1-29a3eb584a54 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-vif-unplugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7dd00392-5b4d-4ce8-8a23-d7a294cf453f req-683d3260-7afa-4925-9da1-29a3eb584a54 service nova] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7dd00392-5b4d-4ce8-8a23-d7a294cf453f req-683d3260-7afa-4925-9da1-29a3eb584a54 service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7dd00392-5b4d-4ce8-8a23-d7a294cf453f req-683d3260-7afa-4925-9da1-29a3eb584a54 service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-7dd00392-5b4d-4ce8-8a23-d7a294cf453f req-683d3260-7afa-4925-9da1-29a3eb584a54 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] No waiting events found dispatching network-vif-unplugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:40:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-7dd00392-5b4d-4ce8-8a23-d7a294cf453f req-683d3260-7afa-4925-9da1-29a3eb584a54 service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-vif-unplugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:40:34 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Instance destroyed successfully.
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lazy-loading 'resources' on Instance uuid e0710ccf-1252-4d29-9b9c-65d0102e20c3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1577539279',display_name='tempest-ServerActionsTestOtherA-server-1577539279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1577539279',id=21,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISXbQZz6hg6SGBAJDvSGRuGor5iGoZzzTiHnl3k9/CZ3Wm3/2J/DS+6aOaZXRk8/zCP8ThehVSlQcgIxUT7ZKFd01cNadodpvhW8IGqPrwuHMR9xFVQ+IkefG2pwvMwKg==',key_name='tempest-keypair-2044657738',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='386bc7deac3d4d57ae29c8461335ca0e',ramdisk_id='',reservation_id='r-vqbnsi59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-752735396',owner_user_name='tempest-ServerActionsTestOtherA-752735396-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:21:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9192e3fb208c401190105a465161ad70',uuid=e0710ccf-1252-4d29-9b9c-65d0102e20c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converting VIF {"id": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "address": "fa:16:3e:7c:e0:a4", "network": {"id": "b33c642e-8439-4791-9459-76f7bc9d8a18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1056004259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "386bc7deac3d4d57ae29c8461335ca0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd16baeb8-bc", "ovs_interfaceid": "d16baeb8-bc61-4b6c-ab85-fbb2ff1af049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:e0:a4,bridge_name='br-int',has_traffic_filtering=True,id=d16baeb8-bc61-4b6c-ab85-fbb2ff1af049,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16baeb8-bc') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG os_vif [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:e0:a4,bridge_name='br-int',has_traffic_filtering=True,id=d16baeb8-bc61-4b6c-ab85-fbb2ff1af049,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16baeb8-bc') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd16baeb8-bc, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:40:34 user nova-compute[72992]: INFO os_vif [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:e0:a4,bridge_name='br-int',has_traffic_filtering=True,id=d16baeb8-bc61-4b6c-ab85-fbb2ff1af049,network=Network(b33c642e-8439-4791-9459-76f7bc9d8a18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd16baeb8-bc')
Aug 15 21:40:34 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Deleting instance files /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3_del
Aug 15 21:40:34 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Deletion of /opt/stack/data/nova/instances/e0710ccf-1252-4d29-9b9c-65d0102e20c3_del complete
Aug 15 21:40:34 user nova-compute[72992]: INFO nova.compute.manager [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 21:40:34 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135619.565664, 7f5d96ae-d869-4100-b3cd-b68eeacdff6e => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:40:34 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] VM Stopped (Lifecycle Event)
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-5f5e0be3-bd05-403e-90cd-f9e47db4db4e None None] [instance: 7f5d96ae-d869-4100-b3cd-b68eeacdff6e] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:40:34 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Took 0.52 seconds to deallocate network for instance.
Aug 15 21:40:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:40:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:40:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:35 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Deleted allocations for instance e0710ccf-1252-4d29-9b9c-65d0102e20c3
Aug 15 21:40:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b1a138e4-f66d-4738-8c5a-17b9415f7892 tempest-ServerActionsTestOtherA-752735396 tempest-ServerActionsTestOtherA-752735396-project-member] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.713s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-a49e55c8-9e62-468c-863f-15af0401ad6e req-a2b825f4-3c4a-4fc6-8062-aa6a55fe0b4f service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:40:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a49e55c8-9e62-468c-863f-15af0401ad6e req-a2b825f4-3c4a-4fc6-8062-aa6a55fe0b4f service nova] Acquiring lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:40:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a49e55c8-9e62-468c-863f-15af0401ad6e req-a2b825f4-3c4a-4fc6-8062-aa6a55fe0b4f service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:40:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a49e55c8-9e62-468c-863f-15af0401ad6e req-a2b825f4-3c4a-4fc6-8062-aa6a55fe0b4f service nova] Lock "e0710ccf-1252-4d29-9b9c-65d0102e20c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:40:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-a49e55c8-9e62-468c-863f-15af0401ad6e req-a2b825f4-3c4a-4fc6-8062-aa6a55fe0b4f service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] No waiting events found dispatching network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:40:35 user nova-compute[72992]: WARNING nova.compute.manager [req-a49e55c8-9e62-468c-863f-15af0401ad6e req-a2b825f4-3c4a-4fc6-8062-aa6a55fe0b4f service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received unexpected event network-vif-plugged-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 for instance with vm_state deleted and task_state None.
Aug 15 21:40:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-a49e55c8-9e62-468c-863f-15af0401ad6e req-a2b825f4-3c4a-4fc6-8062-aa6a55fe0b4f service nova] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Received event network-vif-deleted-d16baeb8-bc61-4b6c-ab85-fbb2ff1af049 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:40:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:40:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:40:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:40:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:40:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:49 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135634.206525, e0710ccf-1252-4d29-9b9c-65d0102e20c3 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:40:49 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] VM Stopped (Lifecycle Event)
Aug 15 21:40:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-adfab524-c830-483a-86c4-73d0b2bfd5c1 None None] [instance: e0710ccf-1252-4d29-9b9c-65d0102e20c3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:40:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:40:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:40:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:26 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:28 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:41:29 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:41:29 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:41:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.411041259765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:41:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:41:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:41:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:41:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:41:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:41:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:41:38 user nova-compute[72992]: INFO nova.compute.claims [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Claim successful on node user
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:41:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.policy [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b84de5c2757e4d72858d4ef2964e7c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84fe668ed3e4a249cafe9f85c41040b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:41:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Creating image(s)
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "/opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "/opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "/opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.171s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk 1073741824" returned: 0 in 0.053s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Cannot resize image /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'migration_context' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Ensure instance console log exists: /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Successfully created port: cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:41:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Successfully updated port: cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:41:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:41:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquired lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:41:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-changed-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.manager [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Refreshing instance network info cache due to event network-changed-cb4fb814-7ed5-4903-9562-a2b5670d3821. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] Acquiring lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating instance_info_cache with network_info: [{"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Releasing lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Instance network_info: |[{"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] Acquired lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.neutron [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Refreshing network info cache for port cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Start _get_guest_xml network_info=[{"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:41:41 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:41:41 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-680028739',display_name='tempest-TestServerVolumeAttachmentScenario-server-680028739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-680028739',id=45,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHagCaJiVF/bozM0XKSvQF02IEUrck7j33IqET9YXc73WLPY2yfSTSfLD4P9bxFC7ObH4+HpddbItNK0GFIN8vb4JYqri0PsctAkiT7TrZxShrj35v+eGXHCZfoyvoPIYQ==',key_name='tempest-keypair-807557130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e84fe668ed3e4a249cafe9f85c41040b',ramdisk_id='',reservation_id='r-q85zi3lt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-956665322',owner_user_name='tempest-TestServerVolumeAttachmentScenario-956665322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b84de5c2757e4d72858d4ef2964e7c30',uuid=b83be28a-ba96-4fa9-857c-c5df3d41c863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Converting VIF {"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:25:fa,bridge_name='br-int',has_traffic_filtering=True,id=cb4fb814-7ed5-4903-9562-a2b5670d3821,network=Network(b4d98f9e-75a5-41b6-96c5-b48b2312ec83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4fb814-7e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'pci_devices' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:41:41 user nova-compute[72992]:   <uuid>b83be28a-ba96-4fa9-857c-c5df3d41c863</uuid>
Aug 15 21:41:41 user nova-compute[72992]:   <name>instance-0000002d</name>
Aug 15 21:41:41 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:41:41 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:41:41 user nova-compute[72992]:   <metadata>
Aug 15 21:41:41 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:41:41 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:41:41 user nova-compute[72992]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-680028739</nova:name>
Aug 15 21:41:41 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:41:41</nova:creationTime>
Aug 15 21:41:41 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:41:41 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:41:41 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:41:41 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:41:41 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:41:41 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:41:41 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:41:41 user nova-compute[72992]:       <nova:owner>
Aug 15 21:41:41 user nova-compute[72992]:         <nova:user uuid="b84de5c2757e4d72858d4ef2964e7c30">tempest-TestServerVolumeAttachmentScenario-956665322-project-member</nova:user>
Aug 15 21:41:41 user nova-compute[72992]:         <nova:project uuid="e84fe668ed3e4a249cafe9f85c41040b">tempest-TestServerVolumeAttachmentScenario-956665322</nova:project>
Aug 15 21:41:41 user nova-compute[72992]:       </nova:owner>
Aug 15 21:41:41 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:41:41 user nova-compute[72992]:       <nova:ports>
Aug 15 21:41:41 user nova-compute[72992]:         <nova:port uuid="cb4fb814-7ed5-4903-9562-a2b5670d3821">
Aug 15 21:41:41 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 21:41:41 user nova-compute[72992]:         </nova:port>
Aug 15 21:41:41 user nova-compute[72992]:       </nova:ports>
Aug 15 21:41:41 user nova-compute[72992]:     </nova:instance>
Aug 15 21:41:41 user nova-compute[72992]:   </metadata>
Aug 15 21:41:41 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:41:41 user nova-compute[72992]:     <system>
Aug 15 21:41:41 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:41:41 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:41:41 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:41:41 user nova-compute[72992]:       <entry name="serial">b83be28a-ba96-4fa9-857c-c5df3d41c863</entry>
Aug 15 21:41:41 user nova-compute[72992]:       <entry name="uuid">b83be28a-ba96-4fa9-857c-c5df3d41c863</entry>
Aug 15 21:41:41 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:41:41 user nova-compute[72992]:     </system>
Aug 15 21:41:41 user nova-compute[72992]:   </sysinfo>
Aug 15 21:41:41 user nova-compute[72992]:   <os>
Aug 15 21:41:41 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:41:41 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:41:41 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:41:41 user nova-compute[72992]:   </os>
Aug 15 21:41:41 user nova-compute[72992]:   <features>
Aug 15 21:41:41 user nova-compute[72992]:     <acpi/>
Aug 15 21:41:41 user nova-compute[72992]:     <apic/>
Aug 15 21:41:41 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:41:41 user nova-compute[72992]:   </features>
Aug 15 21:41:41 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:41:41 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:41:41 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:41:41 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:41:41 user nova-compute[72992]:   </clock>
Aug 15 21:41:41 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:41:41 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:41:41 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:41:41 user nova-compute[72992]:   </cpu>
Aug 15 21:41:41 user nova-compute[72992]:   <devices>
Aug 15 21:41:41 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:41:41 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:41:41 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk"/>
Aug 15 21:41:41 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:41:41 user nova-compute[72992]:     </disk>
Aug 15 21:41:41 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:41:41 user nova-compute[72992]:       <mac address="fa:16:3e:1a:25:fa"/>
Aug 15 21:41:41 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:41:41 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:41:41 user nova-compute[72992]:       <target dev="tapcb4fb814-7e"/>
Aug 15 21:41:41 user nova-compute[72992]:     </interface>
Aug 15 21:41:41 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:41:41 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/console.log" append="off"/>
Aug 15 21:41:41 user nova-compute[72992]:     </serial>
Aug 15 21:41:41 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:41:41 user nova-compute[72992]:     <video>
Aug 15 21:41:41 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:41:41 user nova-compute[72992]:     </video>
Aug 15 21:41:41 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:41:41 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:41:41 user nova-compute[72992]:     </rng>
Aug 15 21:41:41 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:41:41 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:41:41 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:41:41 user nova-compute[72992]:     </memballoon>
Aug 15 21:41:41 user nova-compute[72992]:   </devices>
Aug 15 21:41:41 user nova-compute[72992]: </domain>
Aug 15 21:41:41 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-680028739',display_name='tempest-TestServerVolumeAttachmentScenario-server-680028739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-680028739',id=45,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHagCaJiVF/bozM0XKSvQF02IEUrck7j33IqET9YXc73WLPY2yfSTSfLD4P9bxFC7ObH4+HpddbItNK0GFIN8vb4JYqri0PsctAkiT7TrZxShrj35v+eGXHCZfoyvoPIYQ==',key_name='tempest-keypair-807557130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e84fe668ed3e4a249cafe9f85c41040b',ramdisk_id='',reservation_id='r-q85zi3lt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-956665322',owner_user_name='tempest-TestServerVolumeAttachmentScenario-956665322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b84de5c2757e4d72858d4ef2964e7c30',uuid=b83be28a-ba96-4fa9-857c-c5df3d41c863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Converting VIF {"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:25:fa,bridge_name='br-int',has_traffic_filtering=True,id=cb4fb814-7ed5-4903-9562-a2b5670d3821,network=Network(b4d98f9e-75a5-41b6-96c5-b48b2312ec83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4fb814-7e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG os_vif [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:25:fa,bridge_name='br-int',has_traffic_filtering=True,id=cb4fb814-7ed5-4903-9562-a2b5670d3821,network=Network(b4d98f9e-75a5-41b6-96c5-b48b2312ec83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4fb814-7e') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb4fb814-7e, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb4fb814-7e, col_values=(('external_ids', {'iface-id': 'cb4fb814-7ed5-4903-9562-a2b5670d3821', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:25:fa', 'vm-uuid': 'b83be28a-ba96-4fa9-857c-c5df3d41c863'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:41 user nova-compute[72992]: INFO os_vif [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:25:fa,bridge_name='br-int',has_traffic_filtering=True,id=cb4fb814-7ed5-4903-9562-a2b5670d3821,network=Network(b4d98f9e-75a5-41b6-96c5-b48b2312ec83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4fb814-7e')
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No VIF found with MAC fa:16:3e:1a:25:fa, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:41:41 user nova-compute[72992]: INFO nova.compute.claims [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Claim successful on node user
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.neutron [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updated VIF entry in instance network info cache for port cb4fb814-7ed5-4903-9562-a2b5670d3821. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.neutron [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating instance_info_cache with network_info: [{"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:41:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-00fa3053-86ea-415d-8822-efc3f4ab2137 req-0f49de05-f69b-4025-b70d-30fb36fb08ad service nova] Releasing lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:41:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:41:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG nova.policy [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '850b33c8246e4cab9bd85d289f26cc95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ddb321608a94ff7b8b16e55bcb704e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:41:42 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Creating image(s)
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.194s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk 1073741824" returned: 0 in 0.071s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Successfully created port: 26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.213s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Cannot resize image /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 21:41:42 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'migration_context' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Ensure instance console log exists: /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Successfully updated port: 26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-changed-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Refreshing instance network info cache due to event network-changed-26c1ffed-2f62-4a2d-8250-b065e4003ee3. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Refreshing network info cache for port 26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:41:43 user nova-compute[72992]: DEBUG nova.network.neutron [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-53b500fc-39b2-42b4-baff-1bb360d95b61 req-2e30322e-45f9-42f9-904d-5fa1bb8ceec7 service nova] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance network_info: |[{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Start _get_guest_xml network_info=[{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:41:44 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:41:44 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'pci_devices' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-e3204dd5-31c0-44a8-b9ca-5a1955e2eb35 req-2c9bc0ec-0ce9-4537-b938-9f0afc4d8b42 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e3204dd5-31c0-44a8-b9ca-5a1955e2eb35 req-2c9bc0ec-0ce9-4537-b938-9f0afc4d8b42 service nova] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e3204dd5-31c0-44a8-b9ca-5a1955e2eb35 req-2c9bc0ec-0ce9-4537-b938-9f0afc4d8b42 service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-e3204dd5-31c0-44a8-b9ca-5a1955e2eb35 req-2c9bc0ec-0ce9-4537-b938-9f0afc4d8b42 service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-e3204dd5-31c0-44a8-b9ca-5a1955e2eb35 req-2c9bc0ec-0ce9-4537-b938-9f0afc4d8b42 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] No waiting events found dispatching network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:41:44 user nova-compute[72992]: WARNING nova.compute.manager [req-e3204dd5-31c0-44a8-b9ca-5a1955e2eb35 req-2c9bc0ec-0ce9-4537-b938-9f0afc4d8b42 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received unexpected event network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 for instance with vm_state building and task_state spawning.
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:41:44 user nova-compute[72992]:   <uuid>286b36d1-01e5-42f8-bb6e-9adaf5879d5d</uuid>
Aug 15 21:41:44 user nova-compute[72992]:   <name>instance-0000002e</name>
Aug 15 21:41:44 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:41:44 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:41:44 user nova-compute[72992]:   <metadata>
Aug 15 21:41:44 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:41:44 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:41:44 user nova-compute[72992]:       <nova:name>tempest-ServerActionsTestOtherB-server-1065318765</nova:name>
Aug 15 21:41:44 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:41:44</nova:creationTime>
Aug 15 21:41:44 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:41:44 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:41:44 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:41:44 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:41:44 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:41:44 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:41:44 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:41:44 user nova-compute[72992]:       <nova:owner>
Aug 15 21:41:44 user nova-compute[72992]:         <nova:user uuid="850b33c8246e4cab9bd85d289f26cc95">tempest-ServerActionsTestOtherB-1658679857-project-member</nova:user>
Aug 15 21:41:44 user nova-compute[72992]:         <nova:project uuid="7ddb321608a94ff7b8b16e55bcb704e1">tempest-ServerActionsTestOtherB-1658679857</nova:project>
Aug 15 21:41:44 user nova-compute[72992]:       </nova:owner>
Aug 15 21:41:44 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:41:44 user nova-compute[72992]:       <nova:ports>
Aug 15 21:41:44 user nova-compute[72992]:         <nova:port uuid="26c1ffed-2f62-4a2d-8250-b065e4003ee3">
Aug 15 21:41:44 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:41:44 user nova-compute[72992]:         </nova:port>
Aug 15 21:41:44 user nova-compute[72992]:       </nova:ports>
Aug 15 21:41:44 user nova-compute[72992]:     </nova:instance>
Aug 15 21:41:44 user nova-compute[72992]:   </metadata>
Aug 15 21:41:44 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:41:44 user nova-compute[72992]:     <system>
Aug 15 21:41:44 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:41:44 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:41:44 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:41:44 user nova-compute[72992]:       <entry name="serial">286b36d1-01e5-42f8-bb6e-9adaf5879d5d</entry>
Aug 15 21:41:44 user nova-compute[72992]:       <entry name="uuid">286b36d1-01e5-42f8-bb6e-9adaf5879d5d</entry>
Aug 15 21:41:44 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:41:44 user nova-compute[72992]:     </system>
Aug 15 21:41:44 user nova-compute[72992]:   </sysinfo>
Aug 15 21:41:44 user nova-compute[72992]:   <os>
Aug 15 21:41:44 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:41:44 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:41:44 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:41:44 user nova-compute[72992]:   </os>
Aug 15 21:41:44 user nova-compute[72992]:   <features>
Aug 15 21:41:44 user nova-compute[72992]:     <acpi/>
Aug 15 21:41:44 user nova-compute[72992]:     <apic/>
Aug 15 21:41:44 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:41:44 user nova-compute[72992]:   </features>
Aug 15 21:41:44 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:41:44 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:41:44 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:41:44 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:41:44 user nova-compute[72992]:   </clock>
Aug 15 21:41:44 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:41:44 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:41:44 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:41:44 user nova-compute[72992]:   </cpu>
Aug 15 21:41:44 user nova-compute[72992]:   <devices>
Aug 15 21:41:44 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:41:44 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:41:44 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk"/>
Aug 15 21:41:44 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:41:44 user nova-compute[72992]:     </disk>
Aug 15 21:41:44 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:41:44 user nova-compute[72992]:       <mac address="fa:16:3e:70:37:5f"/>
Aug 15 21:41:44 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:41:44 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:41:44 user nova-compute[72992]:       <target dev="tap26c1ffed-2f"/>
Aug 15 21:41:44 user nova-compute[72992]:     </interface>
Aug 15 21:41:44 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:41:44 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/console.log" append="off"/>
Aug 15 21:41:44 user nova-compute[72992]:     </serial>
Aug 15 21:41:44 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:41:44 user nova-compute[72992]:     <video>
Aug 15 21:41:44 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:41:44 user nova-compute[72992]:     </video>
Aug 15 21:41:44 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:41:44 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:41:44 user nova-compute[72992]:     </rng>
Aug 15 21:41:44 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:41:44 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:41:44 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:41:44 user nova-compute[72992]:     </memballoon>
Aug 15 21:41:44 user nova-compute[72992]:   </devices>
Aug 15 21:41:44 user nova-compute[72992]: </domain>
Aug 15 21:41:44 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG os_vif [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c1ffed-2f, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26c1ffed-2f, col_values=(('external_ids', {'iface-id': '26c1ffed-2f62-4a2d-8250-b065e4003ee3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:37:5f', 'vm-uuid': '286b36d1-01e5-42f8-bb6e-9adaf5879d5d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:44 user nova-compute[72992]: INFO os_vif [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f')
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:41:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No VIF found with MAC fa:16:3e:70:37:5f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135705.1722627, b83be28a-ba96-4fa9-857c-c5df3d41c863 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:41:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] VM Resumed (Lifecycle Event)
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:41:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Instance spawned successfully.
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135705.1760294, b83be28a-ba96-4fa9-857c-c5df3d41c863 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:41:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] VM Started (Lifecycle Event)
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:41:45 user nova-compute[72992]: INFO nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Took 6.76 seconds to spawn the instance on the hypervisor.
Aug 15 21:41:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:41:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:41:45 user nova-compute[72992]: INFO nova.compute.manager [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Took 7.34 seconds to build instance.
Aug 15 21:41:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e4a7761e-fd07-42a2-9c20-7adb59b701b1 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.436s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-7969a803-a343-4d04-a8af-7077c28ea65e req-05493b71-7f6a-4d17-88bb-b8eade970802 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7969a803-a343-4d04-a8af-7077c28ea65e req-05493b71-7f6a-4d17-88bb-b8eade970802 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7969a803-a343-4d04-a8af-7077c28ea65e req-05493b71-7f6a-4d17-88bb-b8eade970802 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-7969a803-a343-4d04-a8af-7077c28ea65e req-05493b71-7f6a-4d17-88bb-b8eade970802 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-7969a803-a343-4d04-a8af-7077c28ea65e req-05493b71-7f6a-4d17-88bb-b8eade970802 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:41:46 user nova-compute[72992]: WARNING nova.compute.manager [req-7969a803-a343-4d04-a8af-7077c28ea65e req-05493b71-7f6a-4d17-88bb-b8eade970802 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state building and task_state spawning.
Aug 15 21:41:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-a902fc21-3f54-4049-a1ca-9339e41cbf1c req-b9ef5326-8a94-4082-8630-1eef2e35975b service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a902fc21-3f54-4049-a1ca-9339e41cbf1c req-b9ef5326-8a94-4082-8630-1eef2e35975b service nova] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a902fc21-3f54-4049-a1ca-9339e41cbf1c req-b9ef5326-8a94-4082-8630-1eef2e35975b service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a902fc21-3f54-4049-a1ca-9339e41cbf1c req-b9ef5326-8a94-4082-8630-1eef2e35975b service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-a902fc21-3f54-4049-a1ca-9339e41cbf1c req-b9ef5326-8a94-4082-8630-1eef2e35975b service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] No waiting events found dispatching network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:41:46 user nova-compute[72992]: WARNING nova.compute.manager [req-a902fc21-3f54-4049-a1ca-9339e41cbf1c req-b9ef5326-8a94-4082-8630-1eef2e35975b service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received unexpected event network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 for instance with vm_state active and task_state None.
Aug 15 21:41:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135708.3375123, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:41:48 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Resumed (Lifecycle Event)
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:41:48 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance spawned successfully.
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-8e2fc361-2de0-4cf1-9bf9-3b4c900b1fa1 req-89c6722d-d831-4421-9937-2b33caec0290 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8e2fc361-2de0-4cf1-9bf9-3b4c900b1fa1 req-89c6722d-d831-4421-9937-2b33caec0290 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8e2fc361-2de0-4cf1-9bf9-3b4c900b1fa1 req-89c6722d-d831-4421-9937-2b33caec0290 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8e2fc361-2de0-4cf1-9bf9-3b4c900b1fa1 req-89c6722d-d831-4421-9937-2b33caec0290 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [req-8e2fc361-2de0-4cf1-9bf9-3b4c900b1fa1 req-89c6722d-d831-4421-9937-2b33caec0290 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:41:48 user nova-compute[72992]: WARNING nova.compute.manager [req-8e2fc361-2de0-4cf1-9bf9-3b4c900b1fa1 req-89c6722d-d831-4421-9937-2b33caec0290 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state building and task_state spawning.
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:41:48 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135708.3421047, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:41:48 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Started (Lifecycle Event)
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:41:48 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:41:48 user nova-compute[72992]: INFO nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Took 6.39 seconds to spawn the instance on the hypervisor.
Aug 15 21:41:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:41:48 user nova-compute[72992]: INFO nova.compute.manager [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Took 6.97 seconds to build instance.
Aug 15 21:41:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-9a64b96d-f376-46e4-8c9e-1bf3266411f9 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.083s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:41:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:41:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:42:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:42:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:42:29 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:42:29 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:42:30 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:42:30 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:42:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8625MB free_disk=25.34270477294922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:42:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b83be28a-ba96-4fa9-857c-c5df3d41c863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:42:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:42:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:42:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:42:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:42:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:42:33 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:42:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:42:34 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating instance_info_cache with network_info: [{"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:42:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:42:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:42:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:42:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:42:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:42:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:42:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:42:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:42:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:43:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:20 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-changed-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Refreshing instance network info cache due to event network-changed-cb4fb814-7ed5-4903-9562-a2b5670d3821. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] Acquiring lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] Acquired lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Refreshing network info cache for port cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG nova.objects.instance [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'flavor' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:43:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updated VIF entry in instance network info cache for port cb4fb814-7ed5-4903-9562-a2b5670d3821. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG nova.network.neutron [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating instance_info_cache with network_info: [{"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-09b2e0b3-a8aa-45df-8970-eb0d3afc2078 req-0919c43e-1e1b-4951-a8c2-712820dd7fa7 service nova] Releasing lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:43:30 user nova-compute[72992]: INFO nova.compute.manager [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Attaching volume 77bc7ba6-00bd-4401-a790-d471ec02e8d4 to /dev/vdb
Aug 15 21:43:30 user nova-compute[72992]: DEBUG os_brick.utils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b2654-5d55-4971-b1b7-6c2de6ed3fb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce40302-7fe1-400f-bd2e-d2f7c2f6988f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5930aa-c20a-41bb-82fa-a4a4485af5e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba01bd61-55e4-4d8d-bdd3-c9e53ab5b476]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:43:30 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6ce2a-cfc9-45f6-b335-52517b05e2f9]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG os_brick.utils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating existing volume attachment record: c57350e2-39fc-46ac-9df2-b23476c61417 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:30 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:31 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:43:31 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:43:31 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=25.341922760009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:43:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:43:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b83be28a-ba96-4fa9-857c-c5df3d41c863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-changed-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Refreshing instance network info cache due to event network-changed-26c1ffed-2f62-4a2d-8250-b065e4003ee3. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG nova.network.neutron [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Refreshing network info cache for port 26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:43:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updated VIF entry in instance network info cache for port 26c1ffed-2f62-4a2d-8250-b065e4003ee3. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:43:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:43:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-afdbe580-ad8c-4151-9442-996b500d06eb req-18248328-a087-46db-a193-5ab98dd55e2a service nova] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:43:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:43:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:43:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:43:35 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:43:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:43:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:43:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:43:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:43:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:43:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHpEoiLs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:43:44 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:43:44 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:43:44 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c2d6a6-808f-4071-8b14-38efb638bf6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:43:44 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa79a27-84ac-492b-af6b-8740c6c5c6ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4] added
Aug 15 21:43:44 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff1755-bd5a-4057-a5bf-8948947f18f7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e8d8a3-ceab-4754-9797-8f35792ed697]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHpEoiLs {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHpEoiLs" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[33179339-f0d8-4ab4-8939-d6c960aaf0e9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHpEoiLs'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad868ec-d368-4bc5-a11d-8ee83ddaef05]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90cc157-35cd-487b-935c-e93906c98680]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:43:44 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:43:44 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:43:44 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:43:44 user nova-compute[72992]: 
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3f8c9e-f252-40b1-8269-d83e6fd7f569]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260]
Aug 15 21:43:44 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260] successful.
Aug 15 21:43:44 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[20be3857-c2c7-4df9-911b-fb261c18f90e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c618839-3e49-44a7-89ee-defed17b984c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:43:44 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:43:44 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79161c0-5f31-41f2-b352-11fc9cc3c78c]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:43:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHpEoiLs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:43:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:43:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26163656236363530', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:43:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163656236363530', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:43:45 user nova-compute[72992]: DEBUG nova.objects.instance [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'flavor' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:43:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:43:45 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:43:45 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 21:43:45 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:43:45 user nova-compute[72992]:   <serial>77bc7ba6-00bd-4401-a790-d471ec02e8d4</serial>
Aug 15 21:43:45 user nova-compute[72992]: </disk>
Aug 15 21:43:45 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:43:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:43:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:43:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No VIF found with MAC fa:16:3e:1a:25:fa, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:43:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-31421369-dd91-46a3-83de-d448b593ade3 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.234s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:43:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'flavor' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:43:49 user nova-compute[72992]: INFO nova.compute.manager [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Attaching volume 909848a5-70b0-402d-a12a-33013471ff03 to /dev/vdc
Aug 15 21:43:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f032090a-cc98-449c-8520-318a0f2437ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b92967-5e2c-4b00-a8d3-5c6b8c3d599a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b1dbda-98dd-4e80-8d53-75cdfcbd6bb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6b5f1-9b67-4e61-95bd-dc3120c541da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:43:49 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:43:49 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b81605-46b3-4a4b-842e-008d00396f74]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG os_brick.utils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:43:49 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating existing volume attachment record: 76447171-6214-4da4-967f-fb9583e2a828 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:43:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXPrRFHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:43:58 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:43:58 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:43:58 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4040041-6b28-4142-9c15-b50dd477d9ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:43:58 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d343476-70cb-44ad-ab1c-2fbd0fef7284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03] added
Aug 15 21:43:58 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0f2ec1-c713-4647-8b9b-68c152391b4a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:58 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab21591-5ae7-480f-8eee-9aa91633db2a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXPrRFHx {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXPrRFHx" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a451c2e8-e6a1-4228-982a-e6769e1ba27a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hXPrRFHx'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[567d8f19-c382-460c-b715-658a1beea5dc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa306b4-541c-4e09-9494-ea9c3f424389]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:43:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:43:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a1f30c-e2fe-4599-a693-cd88a033f193]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260]
Aug 15 21:43:59 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260] successful.
Aug 15 21:43:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6959a5-8e6c-467c-bf60-9619cde5b8fb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9960ac2-7553-4149-b191-b5302b1e695d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:43:59 user nova-compute[72992]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 (non-flash)
Aug 15 21:43:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:43:59 user nova-compute[72992]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 (non-flash)
Aug 15 21:43:59 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ab480-d700-4b02-8cd3-5764593b3368]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:43:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXPrRFHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26238633836366161', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238633836366161', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG nova.objects.instance [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'flavor' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:44:00 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:44:00 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:44:00 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:44:00 user nova-compute[72992]:   <serial>909848a5-70b0-402d-a12a-33013471ff03</serial>
Aug 15 21:44:00 user nova-compute[72992]: </disk>
Aug 15 21:44:00 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] No VIF found with MAC fa:16:3e:1a:25:fa, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:44:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-688fd8b4-b8ef-4352-b043-b8aef49ab5b6 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.055s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:01 user nova-compute[72992]: INFO nova.compute.manager [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Detaching volume 909848a5-70b0-402d-a12a-33013471ff03
Aug 15 21:44:01 user nova-compute[72992]: INFO nova.virt.block_device [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Attempting to driver detach volume 909848a5-70b0-402d-a12a-33013471ff03 from mountpoint /dev/vdc
Aug 15 21:44:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Attempting to detach device vdc from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:44:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:44:01 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:44:01 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:44:01 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:44:01 user nova-compute[72992]:   <serial>909848a5-70b0-402d-a12a-33013471ff03</serial>
Aug 15 21:44:01 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 21:44:01 user nova-compute[72992]: </disk>
Aug 15 21:44:01 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:44:01 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Successfully detached device vdc from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the persistent domain config.
Aug 15 21:44:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:44:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:44:01 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:44:01 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:44:01 user nova-compute[72992]:   <target dev="vdc" bus="virtio"/>
Aug 15 21:44:01 user nova-compute[72992]:   <serial>909848a5-70b0-402d-a12a-33013471ff03</serial>
Aug 15 21:44:01 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 21:44:01 user nova-compute[72992]: </disk>
Aug 15 21:44:01 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135842.2926395, b83be28a-ba96-4fa9-857c-c5df3d41c863 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:44:02 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Successfully detached device vdc from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the live domain config.
Aug 15 21:44:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXPrRFHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:44:02 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0571b88b-5a10-43fb-a6dc-547a83413c4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec3ee94-4008-41f4-874c-80a62f51cc58]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:02 user nova-compute[72992]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 (non-flash)
Aug 15 21:44:02 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:02 user nova-compute[72992]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 (non-flash)
Aug 15 21:44:02 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c885ae560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8df520-793c-40fb-b75f-c5c216ee5355]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd9838c-c4ce-4625-ba0b-3bc9f8a252b8]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d10f8-c7c8-41c0-811d-c7540724fb9e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4e9452-7ee2-4dba-9124-ec15fc93b981]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd4df0d-3b3a-4c05-92da-01a638e204a2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee39fcd3-2cf8-46a1-b84c-3a7326765b85]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260]
Aug 15 21:44:02 user nova-compute[72992]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03, portal: 172.16.0.220,3260] successful.
Aug 15 21:44:02 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:909848a5-70b0-402d-a12a-33013471ff03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5468b83b-63e0-4911-8ff6-f03eb37bfe30]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] <== disconnect_volume: return (288ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:44:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:03 user nova-compute[72992]: DEBUG nova.objects.instance [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'flavor' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-36c9ac7b-25c2-45e3-aa41-e28a549304cc tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.568s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:44:21 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:22 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:44:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:44:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:44:33 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=25.340316772460938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b83be28a-ba96-4fa9-857c-c5df3d41c863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:44:36 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:37 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating instance_info_cache with network_info: [{"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:44:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-b83be28a-ba96-4fa9-857c-c5df3d41c863" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:44:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:44:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'flavor' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Attaching volume 96177028-14de-4534-aeec-10630a6e8752 to /dev/vdb
Aug 15 21:44:38 user nova-compute[72992]: DEBUG os_brick.utils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9996edd-13a5-4969-8dc9-ea82228a9c9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a113773-4dcb-44fe-8ef1-52d480ee2fcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fdeddf-b55d-4f6f-b9cb-6aa58d233e9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62687ef3-079b-46b7-afb6-8739a221d7f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:44:38 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:44:38 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db1a33-8a21-4fe2-bae7-89ce980d623c]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG os_brick.utils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:44:38 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating existing volume attachment record: 3483b85f-575d-4735-955a-43aaf5460a20 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:44:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:44:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:44:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:44:47 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:44:47 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:44:47 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[217dc9db-3cfa-4786-9b27-c807600ee9f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:44:47 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d0e36-ad4e-4e08-b120-48202f441896]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752] added
Aug 15 21:44:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e2e11-1774-4f90-b287-0424877ecc6e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[797bf24f-dfb3-459b-810c-339e08e1b933]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yReLJwua {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yReLJwua" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14513c-77f0-405d-bf84-718ee139d1db]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yReLJwua'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31613f3-f141-4031-bfcd-8f6b6adb7d76]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4730bf-289d-4066-bf21-e94113ccc9bf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a40cd8a-de97-40e4-a27b-d74bfe96d32b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]
Aug 15 21:44:47 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.
Aug 15 21:44:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf3685-c263-4ab8-aa95-4f20903d8939]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[559ca304-c68a-4e85-aff7-c1dcb0fd68ff]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:47 user nova-compute[72992]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:44:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:47 user nova-compute[72992]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:44:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[845c3413-b0e4-42de-9023-e13b7a31bf96]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:44:48 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:44:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:44:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:44:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23464353130646539', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:44:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464353130646539', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:44:48 user nova-compute[72992]: DEBUG nova.objects.instance [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'flavor' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 21:44:48 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:44:48 user nova-compute[72992]:   <source dev="/dev/sdc"/>
Aug 15 21:44:48 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:44:48 user nova-compute[72992]:   <serial>96177028-14de-4534-aeec-10630a6e8752</serial>
Aug 15 21:44:48 user nova-compute[72992]: </disk>
Aug 15 21:44:48 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 21:44:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:44:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:44:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No VIF found with MAC fa:16:3e:70:37:5f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:44:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-8f99c979-2b25-4831-9ff1-e04ec7cbaa85 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.855s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Stashing vm_state: active {{(pid=72992) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'pci_requests' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:44:51 user nova-compute[72992]: INFO nova.compute.claims [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Claim successful on node user
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'resources' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'pci_devices' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:51 user nova-compute[72992]: INFO nova.compute.resource_tracker [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating resource usage from migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54
Aug 15 21:44:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.246s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:51 user nova-compute[72992]: INFO nova.compute.manager [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Migrating
Aug 15 21:44:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:44:51 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:52 user nova-compute[72992]: INFO nova.compute.manager [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Detaching volume 77bc7ba6-00bd-4401-a790-d471ec02e8d4
Aug 15 21:44:52 user nova-compute[72992]: INFO nova.virt.block_device [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Attempting to driver detach volume 77bc7ba6-00bd-4401-a790-d471ec02e8d4 from mountpoint /dev/vdb
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Attempting to detach device vdb from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:44:52 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:44:52 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 21:44:52 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:44:52 user nova-compute[72992]:   <serial>77bc7ba6-00bd-4401-a790-d471ec02e8d4</serial>
Aug 15 21:44:52 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:44:52 user nova-compute[72992]: </disk>
Aug 15 21:44:52 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:44:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Successfully detached device vdb from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the persistent domain config.
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 21:44:52 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:44:52 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 21:44:52 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 21:44:52 user nova-compute[72992]:   <serial>77bc7ba6-00bd-4401-a790-d471ec02e8d4</serial>
Aug 15 21:44:52 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 21:44:52 user nova-compute[72992]: </disk>
Aug 15 21:44:52 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692135892.8830388, b83be28a-ba96-4fa9-857c-c5df3d41c863 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 21:44:52 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Successfully detached device vdb from instance b83be28a-ba96-4fa9-857c-c5df3d41c863 from the live domain config.
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHpEoiLs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:44:52 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe8573-c436-4329-af5b-0ae361e801c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5e3f2-121c-42b9-8e67-0126824a40d4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:52 user nova-compute[72992]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:44:52 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 (non-flash)
Aug 15 21:44:52 user nova-compute[72992]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:44:52 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64edb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Starting migrate_disk_and_power_off {{(pid=72992) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d7308-3045-4a37-aa2e-7871aedf0620]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8ccf2-dd89-4fa3-b2fe-f91de1d22fa2]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:44:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[283e8e76-078d-4069-a98b-307b052399a7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2d2e2c-b142-4a60-ba9d-53fd41b8c487]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c12d77-cd56-427f-bba3-66b245070ecc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd640f-2abb-4ea5-b727-f40685db1f73]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260]
Aug 15 21:44:53 user nova-compute[72992]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4, portal: 172.16.0.220,3260] successful.
Aug 15 21:44:53 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77bc7ba6-00bd-4401-a790-d471ec02e8d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7142d7-0803-4f25-88f0-9be309600c2b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] <== disconnect_volume: return (287ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-cddea7c9-6f9b-45a3-8c6b-d8f5e4bd9bef req-9dd61d42-f4e8-4467-90b6-1086393a2758 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cddea7c9-6f9b-45a3-8c6b-d8f5e4bd9bef req-9dd61d42-f4e8-4467-90b6-1086393a2758 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cddea7c9-6f9b-45a3-8c6b-d8f5e4bd9bef req-9dd61d42-f4e8-4467-90b6-1086393a2758 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-cddea7c9-6f9b-45a3-8c6b-d8f5e4bd9bef req-9dd61d42-f4e8-4467-90b6-1086393a2758 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.compute.manager [req-cddea7c9-6f9b-45a3-8c6b-d8f5e4bd9bef req-9dd61d42-f4e8-4467-90b6-1086393a2758 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:44:53 user nova-compute[72992]: WARNING nova.compute.manager [req-cddea7c9-6f9b-45a3-8c6b-d8f5e4bd9bef req-9dd61d42-f4e8-4467-90b6-1086393a2758 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state resize_migrating.
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance destroyed successfully.
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1737778629-network", "vif_mac": "fa:16:3e:70:37:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1737778629-network", "vif_mac": "fa:16:3e:70:37:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_vif [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c1ffed-2f, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:53 user nova-compute[72992]: INFO os_vif [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f')
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:44:53 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[849733d2-1c02-4be9-97d3-fd1c7e28fdd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c3f35-c9ac-4efd-a112-409ec94d6b5d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:44:53 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:44:53 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64eda8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[506e91ec-e706-4c96-a876-2c8d2b86fd72]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54720eb-6386-45a0-8ec8-8ccd5072bbbc]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fce1c6-8bc3-4b63-b72f-e26b3de27f24]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[463f83b1-b247-4d5c-9eae-508215615fcb]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f446d3a4-7639-4077-ba25-332b876734c3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:53 user nova-compute[72992]: DEBUG nova.objects.instance [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'flavor' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b53660-270d-4d5d-8c6b-aa5cf9228438]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]
Aug 15 21:44:54 user nova-compute[72992]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.
Aug 15 21:44:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-94b7c329-ec27-45d5-b506-934b2653ee97 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.652s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16656f1-9737-4841-a52a-c1eee53118d6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== disconnect_volume: return (272ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d_resize/disk /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "cp -r /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d_resize/disk /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk" returned: 0 in 0.241s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d_resize/disk.info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk.info {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "cp -r /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d_resize/disk.info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk.info" returned: 0 in 0.038s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:44:55 user nova-compute[72992]: WARNING nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state resize_migrating.
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:44:55 user nova-compute[72992]: WARNING nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state resize_migrating.
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:44:55 user nova-compute[72992]: WARNING nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state resize_migrating.
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:44:55 user nova-compute[72992]: WARNING nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state resize_migrating.
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:44:55 user nova-compute[72992]: WARNING nova.compute.manager [req-91d89d42-e18a-49b4-8c02-dd6f1ff183db req-3964b575-0bb2-465b-8677-c1943f4926f0 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state resize_migrating.
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Port 26c1ffed-2f62-4a2d-8250-b065e4003ee3 binding to destination host user is already ACTIVE {{(pid=72992) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:44:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eead667-fd67-4551-bfd4-e687944274bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2d5dc4-8326-4150-b214-ff349d198a09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e55fe2-f20a-42d6-a090-d3675ed2eafe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc94803-32f3-4207-9887-11cdc7c1ae6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:44:56 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:44:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214d2ea-dbfb-486b-a8c7-f51e2a9a847b]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:44:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:44:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:45:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:45:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:45:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:45:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:45:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Starting finish_migration {{(pid=72992) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 21:45:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance directory exists: not creating {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 21:45:04 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Creating image(s)
Aug 15 21:45:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'trusted_certs' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:45:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk. size=21474836480 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk 21474836480 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk 21474836480" returned: 0 in 0.060s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Ensure instance console log exists: /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Start _get_guest_xml network_info=[{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1737778629-network", "vif_mac": "fa:16:3e:70:37:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '286b36d1-01e5-42f8-bb6e-9adaf5879d5d', 'attached_at': '2023-08-15T21:45:05.000000', 'detached_at': '', 'volume_id': '96177028-14de-4534-aeec-10630a6e8752', 'serial': '96177028-14de-4534-aeec-10630a6e8752'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'b88540ad-b70c-4f85-8f1a-22e61e142aaf', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:45:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:45:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'vcpu_model' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:45:05 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:45:05 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:45:05 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b408509c-ace7-41d1-b023-1b50bc1f924a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:45:05 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4787ec2e-de80-4d11-a63b-5bc5445424dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752] added
Aug 15 21:45:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6fdd65-845a-4342-8241-f3cb8ed5b6eb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2eed23-a1ce-4042-a781-0520aa944f95]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yReLJwua {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yReLJwua" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[793f2988-86b4-44ae-b9a2-df7462b253f8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yReLJwua'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bba74b7-3247-4825-baf3-2db80b380462]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f030961-d496-4a11-8d6f-358b8a3f1f96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:45:05 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:45:05 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:45:05 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:45:05 user nova-compute[72992]: 
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c692c4-24d5-4038-a339-209275537750]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]
Aug 15 21:45:05 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.
Aug 15 21:45:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e359a945-e393-40b5-99af-9c9e71490f19]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f250c2f0-cd2c-4d8b-9f37-9c7b1d110b64]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:45:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:45:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a0ba9-bdf5-415f-847a-5d8f6bea4db2]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:45:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23464353130646539', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464353130646539', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1737778629-network", "vif_mac": "fa:16:3e:70:37:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1737778629-network", "vif_mac": "fa:16:3e:70:37:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:45:06 user nova-compute[72992]:   <uuid>286b36d1-01e5-42f8-bb6e-9adaf5879d5d</uuid>
Aug 15 21:45:06 user nova-compute[72992]:   <name>instance-0000002e</name>
Aug 15 21:45:06 user nova-compute[72992]:   <memory>2097152</memory>
Aug 15 21:45:06 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:45:06 user nova-compute[72992]:   <metadata>
Aug 15 21:45:06 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:45:06 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:45:06 user nova-compute[72992]:       <nova:name>tempest-ServerActionsTestOtherB-server-1065318765</nova:name>
Aug 15 21:45:06 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:45:05</nova:creationTime>
Aug 15 21:45:06 user nova-compute[72992]:       <nova:flavor name="m1.small">
Aug 15 21:45:06 user nova-compute[72992]:         <nova:memory>2048</nova:memory>
Aug 15 21:45:06 user nova-compute[72992]:         <nova:disk>20</nova:disk>
Aug 15 21:45:06 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:45:06 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:45:06 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:45:06 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:45:06 user nova-compute[72992]:       <nova:owner>
Aug 15 21:45:06 user nova-compute[72992]:         <nova:user uuid="850b33c8246e4cab9bd85d289f26cc95">tempest-ServerActionsTestOtherB-1658679857-project-member</nova:user>
Aug 15 21:45:06 user nova-compute[72992]:         <nova:project uuid="7ddb321608a94ff7b8b16e55bcb704e1">tempest-ServerActionsTestOtherB-1658679857</nova:project>
Aug 15 21:45:06 user nova-compute[72992]:       </nova:owner>
Aug 15 21:45:06 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:45:06 user nova-compute[72992]:       <nova:ports>
Aug 15 21:45:06 user nova-compute[72992]:         <nova:port uuid="26c1ffed-2f62-4a2d-8250-b065e4003ee3">
Aug 15 21:45:06 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:45:06 user nova-compute[72992]:         </nova:port>
Aug 15 21:45:06 user nova-compute[72992]:       </nova:ports>
Aug 15 21:45:06 user nova-compute[72992]:     </nova:instance>
Aug 15 21:45:06 user nova-compute[72992]:   </metadata>
Aug 15 21:45:06 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:45:06 user nova-compute[72992]:     <system>
Aug 15 21:45:06 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:45:06 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:45:06 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:45:06 user nova-compute[72992]:       <entry name="serial">286b36d1-01e5-42f8-bb6e-9adaf5879d5d</entry>
Aug 15 21:45:06 user nova-compute[72992]:       <entry name="uuid">286b36d1-01e5-42f8-bb6e-9adaf5879d5d</entry>
Aug 15 21:45:06 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:45:06 user nova-compute[72992]:     </system>
Aug 15 21:45:06 user nova-compute[72992]:   </sysinfo>
Aug 15 21:45:06 user nova-compute[72992]:   <os>
Aug 15 21:45:06 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:45:06 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:45:06 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:45:06 user nova-compute[72992]:   </os>
Aug 15 21:45:06 user nova-compute[72992]:   <features>
Aug 15 21:45:06 user nova-compute[72992]:     <acpi/>
Aug 15 21:45:06 user nova-compute[72992]:     <apic/>
Aug 15 21:45:06 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:45:06 user nova-compute[72992]:   </features>
Aug 15 21:45:06 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:45:06 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:45:06 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:45:06 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:45:06 user nova-compute[72992]:   </clock>
Aug 15 21:45:06 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:45:06 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:45:06 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:45:06 user nova-compute[72992]:   </cpu>
Aug 15 21:45:06 user nova-compute[72992]:   <devices>
Aug 15 21:45:06 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:45:06 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:45:06 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk"/>
Aug 15 21:45:06 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:45:06 user nova-compute[72992]:     </disk>
Aug 15 21:45:06 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:45:06 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:45:06 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:45:06 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:45:06 user nova-compute[72992]:       <serial>96177028-14de-4534-aeec-10630a6e8752</serial>
Aug 15 21:45:06 user nova-compute[72992]:     </disk>
Aug 15 21:45:06 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:45:06 user nova-compute[72992]:       <mac address="fa:16:3e:70:37:5f"/>
Aug 15 21:45:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:45:06 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:45:06 user nova-compute[72992]:       <target dev="tap26c1ffed-2f"/>
Aug 15 21:45:06 user nova-compute[72992]:     </interface>
Aug 15 21:45:06 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:45:06 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/console.log" append="off"/>
Aug 15 21:45:06 user nova-compute[72992]:     </serial>
Aug 15 21:45:06 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:45:06 user nova-compute[72992]:     <video>
Aug 15 21:45:06 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:45:06 user nova-compute[72992]:     </video>
Aug 15 21:45:06 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:45:06 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:45:06 user nova-compute[72992]:     </rng>
Aug 15 21:45:06 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:45:06 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:45:06 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:45:06 user nova-compute[72992]:     </memballoon>
Aug 15 21:45:06 user nova-compute[72992]:   </devices>
Aug 15 21:45:06 user nova-compute[72992]: </domain>
Aug 15 21:45:06 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1737778629-network", "vif_mac": "fa:16:3e:70:37:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1737778629-network", "vif_mac": "fa:16:3e:70:37:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG os_vif [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c1ffed-2f, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26c1ffed-2f, col_values=(('external_ids', {'iface-id': '26c1ffed-2f62-4a2d-8250-b065e4003ee3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:37:5f', 'vm-uuid': '286b36d1-01e5-42f8-bb6e-9adaf5879d5d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:06 user nova-compute[72992]: INFO os_vif [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f')
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:45:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] No VIF found with MAC fa:16:3e:70:37:5f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-bd7b8be6-aa7a-4a11-ac9d-a3a5c4b48a1e req-d40e9a69-f679-44b6-a7b2-488be904af07 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bd7b8be6-aa7a-4a11-ac9d-a3a5c4b48a1e req-d40e9a69-f679-44b6-a7b2-488be904af07 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bd7b8be6-aa7a-4a11-ac9d-a3a5c4b48a1e req-d40e9a69-f679-44b6-a7b2-488be904af07 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-bd7b8be6-aa7a-4a11-ac9d-a3a5c4b48a1e req-d40e9a69-f679-44b6-a7b2-488be904af07 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG nova.compute.manager [req-bd7b8be6-aa7a-4a11-ac9d-a3a5c4b48a1e req-d40e9a69-f679-44b6-a7b2-488be904af07 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:45:08 user nova-compute[72992]: WARNING nova.compute.manager [req-bd7b8be6-aa7a-4a11-ac9d-a3a5c4b48a1e req-d40e9a69-f679-44b6-a7b2-488be904af07 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state resize_finish.
Aug 15 21:45:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:08 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135893.737418, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:45:08 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Stopped (Lifecycle Event)
Aug 15 21:45:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f9a8ce3a-54c2-4da9-a247-09d256b46dc2 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135910.2003305, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:45:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Resumed (Lifecycle Event)
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:45:10 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance running successfully.
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Failed to set time: agent not configured {{(pid=72992) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e02d1950-aa5d-4b62-8411-175db87daf99 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] finish_migration finished successfully. {{(pid=72992) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:45:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692135910.2052033, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:45:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Started (Lifecycle Event)
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:45:10 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-4e77fec8-62c9-4eb9-882b-0aefe72bb628 req-96a235de-1e24-4129-8944-d4084e30cc02 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4e77fec8-62c9-4eb9-882b-0aefe72bb628 req-96a235de-1e24-4129-8944-d4084e30cc02 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4e77fec8-62c9-4eb9-882b-0aefe72bb628 req-96a235de-1e24-4129-8944-d4084e30cc02 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4e77fec8-62c9-4eb9-882b-0aefe72bb628 req-96a235de-1e24-4129-8944-d4084e30cc02 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-4e77fec8-62c9-4eb9-882b-0aefe72bb628 req-96a235de-1e24-4129-8944-d4084e30cc02 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:45:10 user nova-compute[72992]: WARNING nova.compute.manager [req-4e77fec8-62c9-4eb9-882b-0aefe72bb628 req-96a235de-1e24-4129-8944-d4084e30cc02 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state resized and task_state None.
Aug 15 21:45:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:24 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:45:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:45:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:45:35 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:45:35 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=25.301837921142578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Applying migration context for instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d as it has an incoming, in-progress migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54. Migration status is finished {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 21:45:36 user nova-compute[72992]: INFO nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating resource usage from migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b83be28a-ba96-4fa9-857c-c5df3d41c863 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=22GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:39 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:45:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:45:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:42 user nova-compute[72992]: INFO nova.compute.manager [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Terminating instance
Aug 15 21:45:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-9d3f50a1-db57-46d7-be07-98b58acd73c8 req-b3d12b3b-dcfb-48ad-a94f-e13d083a2190 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-vif-unplugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9d3f50a1-db57-46d7-be07-98b58acd73c8 req-b3d12b3b-dcfb-48ad-a94f-e13d083a2190 service nova] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9d3f50a1-db57-46d7-be07-98b58acd73c8 req-b3d12b3b-dcfb-48ad-a94f-e13d083a2190 service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9d3f50a1-db57-46d7-be07-98b58acd73c8 req-b3d12b3b-dcfb-48ad-a94f-e13d083a2190 service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-9d3f50a1-db57-46d7-be07-98b58acd73c8 req-b3d12b3b-dcfb-48ad-a94f-e13d083a2190 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] No waiting events found dispatching network-vif-unplugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-9d3f50a1-db57-46d7-be07-98b58acd73c8 req-b3d12b3b-dcfb-48ad-a94f-e13d083a2190 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-vif-unplugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Instance destroyed successfully.
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lazy-loading 'resources' on Instance uuid b83be28a-ba96-4fa9-857c-c5df3d41c863 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-680028739',display_name='tempest-TestServerVolumeAttachmentScenario-server-680028739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-680028739',id=45,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHagCaJiVF/bozM0XKSvQF02IEUrck7j33IqET9YXc73WLPY2yfSTSfLD4P9bxFC7ObH4+HpddbItNK0GFIN8vb4JYqri0PsctAkiT7TrZxShrj35v+eGXHCZfoyvoPIYQ==',key_name='tempest-keypair-807557130',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e84fe668ed3e4a249cafe9f85c41040b',ramdisk_id='',reservation_id='r-q85zi3lt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-956665322',owner_user_name='tempest-TestServerVolumeAttachmentScenario-956665322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b84de5c2757e4d72858d4ef2964e7c30',uuid=b83be28a-ba96-4fa9-857c-c5df3d41c863,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Converting VIF {"id": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "address": "fa:16:3e:1a:25:fa", "network": {"id": "b4d98f9e-75a5-41b6-96c5-b48b2312ec83", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1392403559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84fe668ed3e4a249cafe9f85c41040b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4fb814-7e", "ovs_interfaceid": "cb4fb814-7ed5-4903-9562-a2b5670d3821", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:25:fa,bridge_name='br-int',has_traffic_filtering=True,id=cb4fb814-7ed5-4903-9562-a2b5670d3821,network=Network(b4d98f9e-75a5-41b6-96c5-b48b2312ec83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4fb814-7e') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG os_vif [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:25:fa,bridge_name='br-int',has_traffic_filtering=True,id=cb4fb814-7ed5-4903-9562-a2b5670d3821,network=Network(b4d98f9e-75a5-41b6-96c5-b48b2312ec83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4fb814-7e') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb4fb814-7e, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:43 user nova-compute[72992]: INFO os_vif [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:25:fa,bridge_name='br-int',has_traffic_filtering=True,id=cb4fb814-7ed5-4903-9562-a2b5670d3821,network=Network(b4d98f9e-75a5-41b6-96c5-b48b2312ec83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4fb814-7e')
Aug 15 21:45:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Deleting instance files /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863_del
Aug 15 21:45:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Deletion of /opt/stack/data/nova/instances/b83be28a-ba96-4fa9-857c-c5df3d41c863_del complete
Aug 15 21:45:43 user nova-compute[72992]: INFO nova.compute.manager [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 21:45:43 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:45:43 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:45:44 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:45:44 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Took 0.83 seconds to deallocate network for instance.
Aug 15 21:45:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-81e8238a-3cae-43a9-83a8-1c812b92d834 req-5c764fa1-b294-45c9-ad72-165e15b83f52 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-vif-deleted-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:45:44 user nova-compute[72992]: INFO nova.compute.manager [req-81e8238a-3cae-43a9-83a8-1c812b92d834 req-5c764fa1-b294-45c9-ad72-165e15b83f52 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Neutron deleted interface cb4fb814-7ed5-4903-9562-a2b5670d3821; detaching it from the instance and deleting it from the info cache
Aug 15 21:45:44 user nova-compute[72992]: DEBUG nova.network.neutron [req-81e8238a-3cae-43a9-83a8-1c812b92d834 req-5c764fa1-b294-45c9-ad72-165e15b83f52 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:45:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-81e8238a-3cae-43a9-83a8-1c812b92d834 req-5c764fa1-b294-45c9-ad72-165e15b83f52 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Detach interface failed, port_id=cb4fb814-7ed5-4903-9562-a2b5670d3821, reason: Instance b83be28a-ba96-4fa9-857c-c5df3d41c863 could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:45:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:44 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:45:44 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:45:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:44 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Deleted allocations for instance b83be28a-ba96-4fa9-857c-c5df3d41c863
Aug 15 21:45:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-069ca8b2-cfea-4525-bb8e-ff91d947eac8 tempest-TestServerVolumeAttachmentScenario-956665322 tempest-TestServerVolumeAttachmentScenario-956665322-project-member] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.027s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-0d6cc815-e4b6-49b7-8ca5-d09620ad7c81 req-cea0fd9f-47c4-4abf-95c2-c9ae61cadea0 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received event network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:45:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0d6cc815-e4b6-49b7-8ca5-d09620ad7c81 req-cea0fd9f-47c4-4abf-95c2-c9ae61cadea0 service nova] Acquiring lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:45:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0d6cc815-e4b6-49b7-8ca5-d09620ad7c81 req-cea0fd9f-47c4-4abf-95c2-c9ae61cadea0 service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:45:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0d6cc815-e4b6-49b7-8ca5-d09620ad7c81 req-cea0fd9f-47c4-4abf-95c2-c9ae61cadea0 service nova] Lock "b83be28a-ba96-4fa9-857c-c5df3d41c863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:45:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-0d6cc815-e4b6-49b7-8ca5-d09620ad7c81 req-cea0fd9f-47c4-4abf-95c2-c9ae61cadea0 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] No waiting events found dispatching network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:45:45 user nova-compute[72992]: WARNING nova.compute.manager [req-0d6cc815-e4b6-49b7-8ca5-d09620ad7c81 req-cea0fd9f-47c4-4abf-95c2-c9ae61cadea0 service nova] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Received unexpected event network-vif-plugged-cb4fb814-7ed5-4903-9562-a2b5670d3821 for instance with vm_state deleted and task_state None.
Aug 15 21:45:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:45:58 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692135943.4743614, b83be28a-ba96-4fa9-857c-c5df3d41c863 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:45:58 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] VM Stopped (Lifecycle Event)
Aug 15 21:45:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-dd8d316b-593f-4800-9031-e779e80efff1 None None] [instance: b83be28a-ba96-4fa9-857c-c5df3d41c863] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:45:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:45:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:45:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:45:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:45:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:45:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:46:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:46:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:46:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:46:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:46:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:46:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:23 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:46:36 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:46:36 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.328964233398438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Applying migration context for instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d as it has an incoming, in-progress migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54. Migration status is finished {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 21:46:36 user nova-compute[72992]: INFO nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating resource usage from migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=21GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:46:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:46:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:40 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:46:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:46:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:46:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:46:40 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:46:40 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Port 26c1ffed-2f62-4a2d-8250-b065e4003ee3 binding to destination host user is already ACTIVE {{(pid=72992) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:46:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Creating tmpfile /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/tmpbhejupy6 to verify with other compute node that the instance is on the same shared storage. {{(pid=72992) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-9f495658-61f1-4b69-bbec-f32c06dbbc47 req-d73df561-f003-488f-81fa-58af6a758eef service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9f495658-61f1-4b69-bbec-f32c06dbbc47 req-d73df561-f003-488f-81fa-58af6a758eef service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9f495658-61f1-4b69-bbec-f32c06dbbc47 req-d73df561-f003-488f-81fa-58af6a758eef service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9f495658-61f1-4b69-bbec-f32c06dbbc47 req-d73df561-f003-488f-81fa-58af6a758eef service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:46:42 user nova-compute[72992]: DEBUG nova.compute.manager [req-9f495658-61f1-4b69-bbec-f32c06dbbc47 req-d73df561-f003-488f-81fa-58af6a758eef service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:46:42 user nova-compute[72992]: WARNING nova.compute.manager [req-9f495658-61f1-4b69-bbec-f32c06dbbc47 req-d73df561-f003-488f-81fa-58af6a758eef service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state resized and task_state resize_reverting.
Aug 15 21:46:43 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance destroyed successfully.
Aug 15 21:46:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'resources' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:45:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_vif [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c1ffed-2f, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:43 user nova-compute[72992]: INFO os_vif [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f')
Aug 15 21:46:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:46:43 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac605e35-af47-4386-b189-f994ea0ebb75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb2277-3768-4af2-9b1b-6de2fa7e9fbc]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:46:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:46:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c8851cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a6b90c-ac23-4210-b265-d868701f5468]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a5f05-1228-4dd1-96e5-53a7c26e96a7]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d19ce6-9e85-4799-b678-2fd256fd2752]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eca1bad-25fa-494b-9098-f2a53bb3417a]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61f2dc1-4bc3-412e-be48-d5bbe3b25f72]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63389c0-71e7-4fb1-aad2-eb6d5c0b6cf2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]
Aug 15 21:46:43 user nova-compute[72992]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.
Aug 15 21:46:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f66a0-0cf8-47b3-9a8d-fdd6ad3b3eb7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== disconnect_volume: return (287ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:46:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'migration_context' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.211s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-0e5f2978-cc06-432d-a89e-b1e9c77002fc req-d9faff23-ec53-4b9c-9933-eece6f8b11b6 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0e5f2978-cc06-432d-a89e-b1e9c77002fc req-d9faff23-ec53-4b9c-9933-eece6f8b11b6 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0e5f2978-cc06-432d-a89e-b1e9c77002fc req-d9faff23-ec53-4b9c-9933-eece6f8b11b6 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-0e5f2978-cc06-432d-a89e-b1e9c77002fc req-d9faff23-ec53-4b9c-9933-eece6f8b11b6 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:46:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-0e5f2978-cc06-432d-a89e-b1e9c77002fc req-d9faff23-ec53-4b9c-9933-eece6f8b11b6 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:46:44 user nova-compute[72992]: WARNING nova.compute.manager [req-0e5f2978-cc06-432d-a89e-b1e9c77002fc req-d9faff23-ec53-4b9c-9933-eece6f8b11b6 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state resized and task_state resize_reverting.
Aug 15 21:46:44 user nova-compute[72992]: INFO nova.compute.manager [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Swapping old allocation on dict_keys(['0ba7034c-2c49-478a-ace5-5ede6ef0ca42']) held by migration ca5d8b48-4daa-4265-a2d9-3eb26da4ab54 for instance
Aug 15 21:46:44 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Overwriting current allocation {'allocations': {'0ba7034c-2c49-478a-ace5-5ede6ef0ca42': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 56}}, 'project_id': '7ddb321608a94ff7b8b16e55bcb704e1', 'user_id': '850b33c8246e4cab9bd85d289f26cc95', 'consumer_generation': 1} on consumer 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG os_brick.utils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0476ce1d-302b-4eca-b7c7-0ed9bd13bf1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a9d24-6609-4a8f-9e4f-1b710d8b73e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[feebfce2-0ddd-47e5-b356-75617440a339]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7fd719-7700-44a6-8c5a-dba0e2e91d57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:46:45 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:46:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043a899-38c2-4321-a7f8-6c0293c6ce78]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:46:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:46:46 user nova-compute[72992]: DEBUG os_brick.utils [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:46:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Starting finish_revert_migration {{(pid=72992) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Start _get_guest_xml network_info=[{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '286b36d1-01e5-42f8-bb6e-9adaf5879d5d', 'attached_at': '2023-08-15T21:46:54.000000', 'detached_at': '', 'volume_id': '96177028-14de-4534-aeec-10630a6e8752', 'serial': '96177028-14de-4534-aeec-10630a6e8752'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '692d66f8-ed24-4486-989f-c269d83f2fae', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:46:54 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:46:54 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'vcpu_model' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:46:54 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:46:54 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:46:54 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b22859-0d45-4e49-b0ee-38a848a182f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:46:54 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[933fd693-88c8-4647-8eaa-aadf896f31eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752] added
Aug 15 21:46:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66f24ef-6d76-46a3-9ebd-e7550933a514]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[de44c0a3-1b41-47e1-a115-d92291c78e01]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yReLJwua {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yReLJwua" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb291f0e-018e-4dd8-bd3d-a8c459e3916f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yReLJwua'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7a9d27-133e-4b30-af28-0dd03d283854]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[318d51e5-af9f-416c-be0d-55d9d0644c2f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:46:54 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:46:54 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:46:54 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:46:54 user nova-compute[72992]: 
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e3b3a-17fb-42b5-89cc-35cc0cd26770]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]
Aug 15 21:46:54 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.
Aug 15 21:46:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[32847233-8ebf-484f-be64-b6916a4bc8ee]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e9d58-6420-4d7c-bc25-bfdc4877b4ab]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:46:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:46:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0338a985-e4fa-4811-bf0a-71ee90b31607]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:46:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23464353130646539', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464353130646539', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:46:55 user nova-compute[72992]:   <uuid>286b36d1-01e5-42f8-bb6e-9adaf5879d5d</uuid>
Aug 15 21:46:55 user nova-compute[72992]:   <name>instance-0000002e</name>
Aug 15 21:46:55 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:46:55 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:46:55 user nova-compute[72992]:   <metadata>
Aug 15 21:46:55 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:46:55 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:46:55 user nova-compute[72992]:       <nova:name>tempest-ServerActionsTestOtherB-server-1065318765</nova:name>
Aug 15 21:46:55 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:46:54</nova:creationTime>
Aug 15 21:46:55 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:46:55 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:46:55 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:46:55 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:46:55 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:46:55 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:46:55 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:46:55 user nova-compute[72992]:       <nova:owner>
Aug 15 21:46:55 user nova-compute[72992]:         <nova:user uuid="850b33c8246e4cab9bd85d289f26cc95">tempest-ServerActionsTestOtherB-1658679857-project-member</nova:user>
Aug 15 21:46:55 user nova-compute[72992]:         <nova:project uuid="7ddb321608a94ff7b8b16e55bcb704e1">tempest-ServerActionsTestOtherB-1658679857</nova:project>
Aug 15 21:46:55 user nova-compute[72992]:       </nova:owner>
Aug 15 21:46:55 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 21:46:55 user nova-compute[72992]:       <nova:ports>
Aug 15 21:46:55 user nova-compute[72992]:         <nova:port uuid="26c1ffed-2f62-4a2d-8250-b065e4003ee3">
Aug 15 21:46:55 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 21:46:55 user nova-compute[72992]:         </nova:port>
Aug 15 21:46:55 user nova-compute[72992]:       </nova:ports>
Aug 15 21:46:55 user nova-compute[72992]:     </nova:instance>
Aug 15 21:46:55 user nova-compute[72992]:   </metadata>
Aug 15 21:46:55 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:46:55 user nova-compute[72992]:     <system>
Aug 15 21:46:55 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:46:55 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:46:55 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:46:55 user nova-compute[72992]:       <entry name="serial">286b36d1-01e5-42f8-bb6e-9adaf5879d5d</entry>
Aug 15 21:46:55 user nova-compute[72992]:       <entry name="uuid">286b36d1-01e5-42f8-bb6e-9adaf5879d5d</entry>
Aug 15 21:46:55 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:46:55 user nova-compute[72992]:     </system>
Aug 15 21:46:55 user nova-compute[72992]:   </sysinfo>
Aug 15 21:46:55 user nova-compute[72992]:   <os>
Aug 15 21:46:55 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:46:55 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:46:55 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:46:55 user nova-compute[72992]:   </os>
Aug 15 21:46:55 user nova-compute[72992]:   <features>
Aug 15 21:46:55 user nova-compute[72992]:     <acpi/>
Aug 15 21:46:55 user nova-compute[72992]:     <apic/>
Aug 15 21:46:55 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:46:55 user nova-compute[72992]:   </features>
Aug 15 21:46:55 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:46:55 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:46:55 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:46:55 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:46:55 user nova-compute[72992]:   </clock>
Aug 15 21:46:55 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:46:55 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:46:55 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:46:55 user nova-compute[72992]:   </cpu>
Aug 15 21:46:55 user nova-compute[72992]:   <devices>
Aug 15 21:46:55 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 21:46:55 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 21:46:55 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk"/>
Aug 15 21:46:55 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:46:55 user nova-compute[72992]:     </disk>
Aug 15 21:46:55 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:46:55 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:46:55 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:46:55 user nova-compute[72992]:       <target dev="vdb" bus="virtio"/>
Aug 15 21:46:55 user nova-compute[72992]:       <serial>96177028-14de-4534-aeec-10630a6e8752</serial>
Aug 15 21:46:55 user nova-compute[72992]:     </disk>
Aug 15 21:46:55 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:46:55 user nova-compute[72992]:       <mac address="fa:16:3e:70:37:5f"/>
Aug 15 21:46:55 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:46:55 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:46:55 user nova-compute[72992]:       <target dev="tap26c1ffed-2f"/>
Aug 15 21:46:55 user nova-compute[72992]:     </interface>
Aug 15 21:46:55 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:46:55 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/console.log" append="off"/>
Aug 15 21:46:55 user nova-compute[72992]:     </serial>
Aug 15 21:46:55 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:46:55 user nova-compute[72992]:     <video>
Aug 15 21:46:55 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:46:55 user nova-compute[72992]:     </video>
Aug 15 21:46:55 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:46:55 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:46:55 user nova-compute[72992]:     </rng>
Aug 15 21:46:55 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:46:55 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:46:55 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:46:55 user nova-compute[72992]:     </memballoon>
Aug 15 21:46:55 user nova-compute[72992]:   </devices>
Aug 15 21:46:55 user nova-compute[72992]: </domain>
Aug 15 21:46:55 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:46:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG os_vif [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:46:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:46:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c1ffed-2f, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:46:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26c1ffed-2f, col_values=(('external_ids', {'iface-id': '26c1ffed-2f62-4a2d-8250-b065e4003ee3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:37:5f', 'vm-uuid': '286b36d1-01e5-42f8-bb6e-9adaf5879d5d'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:46:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:46:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:56 user nova-compute[72992]: INFO os_vif [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f')
Aug 15 21:46:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-661d3cb9-8054-440f-b8f2-223af2d1237c req-fecc3aa2-a253-495c-b281-57109fc1f0e4 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-661d3cb9-8054-440f-b8f2-223af2d1237c req-fecc3aa2-a253-495c-b281-57109fc1f0e4 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-661d3cb9-8054-440f-b8f2-223af2d1237c req-fecc3aa2-a253-495c-b281-57109fc1f0e4 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-661d3cb9-8054-440f-b8f2-223af2d1237c req-fecc3aa2-a253-495c-b281-57109fc1f0e4 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-661d3cb9-8054-440f-b8f2-223af2d1237c req-fecc3aa2-a253-495c-b281-57109fc1f0e4 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:46:57 user nova-compute[72992]: WARNING nova.compute.manager [req-661d3cb9-8054-440f-b8f2-223af2d1237c req-fecc3aa2-a253-495c-b281-57109fc1f0e4 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state resized and task_state resize_reverting.
Aug 15 21:46:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:58 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692136003.1738212, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:46:58 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Stopped (Lifecycle Event)
Aug 15 21:46:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-69f7369c-0064-4fb7-8517-1f29136b3ab2 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136019.4629703, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:46:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Resumed (Lifecycle Event)
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:46:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance running successfully.
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] finish_revert_migration finished successfully. {{(pid=72992) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:46:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136019.4681706, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:46:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Started (Lifecycle Event)
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:46:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-fe0bcdd6-bc08-4f5e-8c33-13a998cccbf9 req-51de318a-ae88-4d89-8cae-b59648becc7f service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fe0bcdd6-bc08-4f5e-8c33-13a998cccbf9 req-51de318a-ae88-4d89-8cae-b59648becc7f service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fe0bcdd6-bc08-4f5e-8c33-13a998cccbf9 req-51de318a-ae88-4d89-8cae-b59648becc7f service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-fe0bcdd6-bc08-4f5e-8c33-13a998cccbf9 req-51de318a-ae88-4d89-8cae-b59648becc7f service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:46:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-fe0bcdd6-bc08-4f5e-8c33-13a998cccbf9 req-51de318a-ae88-4d89-8cae-b59648becc7f service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:46:59 user nova-compute[72992]: WARNING nova.compute.manager [req-fe0bcdd6-bc08-4f5e-8c33-13a998cccbf9 req-51de318a-ae88-4d89-8cae-b59648becc7f service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state resized and task_state resize_reverting.
Aug 15 21:46:59 user nova-compute[72992]: INFO nova.compute.manager [None req-c25682a3-938b-4f0c-bfa7-7c4d883b3aba tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance to original state: 'active'
Aug 15 21:47:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:47:26 user nova-compute[72992]: INFO nova.compute.claims [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Claim successful on node user
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:47:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:47:26 user nova-compute[72992]: INFO nova.virt.block_device [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Booting with volume snapshot 8e2b8d4d-404b-4e42-9b6a-57da43c65d85 at /dev/vda
Aug 15 21:47:26 user nova-compute[72992]: DEBUG nova.policy [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ac4abe94f1400c9ffc2dc1e7725253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb04a16dcfc4270a451facd41d87968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:47:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:27 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Successfully created port: f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:47:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Successfully updated port: f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "refresh_cache-88d291f1-bd1d-43c2-9888-4d6ac16b33c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquired lock "refresh_cache-88d291f1-bd1d-43c2-9888-4d6ac16b33c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received event network-changed-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Refreshing instance network info cache due to event network-changed-f3c39ec3-3b75-43aa-a638-060fc358fd05. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] Acquiring lock "refresh_cache-88d291f1-bd1d-43c2-9888-4d6ac16b33c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:47:28 user nova-compute[72992]: DEBUG nova.network.neutron [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Updating instance_info_cache with network_info: [{"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:47:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Releasing lock "refresh_cache-88d291f1-bd1d-43c2-9888-4d6ac16b33c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:47:29 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Instance network_info: |[{"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:47:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] Acquired lock "refresh_cache-88d291f1-bd1d-43c2-9888-4d6ac16b33c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:47:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Refreshing network info cache for port f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:47:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Updated VIF entry in instance network info cache for port f3c39ec3-3b75-43aa-a638-060fc358fd05. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:47:29 user nova-compute[72992]: DEBUG nova.network.neutron [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Updating instance_info_cache with network_info: [{"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:47:29 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1315b743-3361-4754-a898-3d3ca9bf06a3 req-59a31453-68d4-4789-8162-52fbb52e68dd service nova] Releasing lock "refresh_cache-88d291f1-bd1d-43c2-9888-4d6ac16b33c6" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:47:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG os_brick.utils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b85ac67-7318-443e-8692-aa7a25603152]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7903c6e6-d64b-4066-bdf9-2e6f0cf0c04e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aefc8e-f9f1-4cd8-b0a7-634a5f1d180c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[25211cef-f3b6-4e66-b951-2acb9d7ada89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:47:32 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:47:32 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e8aa76-e21e-4785-a6f5-e5f2b9d701d2]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG os_brick.utils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Updating existing volume attachment record: 1fbbb6d2-fc0e-46df-8234-cf857926f2e6 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:47:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:47:37 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:47:37 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.353374481201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:47:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:38 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:47:41 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Creating image(s)
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Ensure instance console log exists: /opt/stack/data/nova/instances/88d291f1-bd1d-43c2-9888-4d6ac16b33c6/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Start _get_guest_xml network_info=[{"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUSxdouP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88d291f1-bd1d-43c2-9888-4d6ac16b33c6', 'attached_at': '', 'detached_at': '', 'volume_id': '1e60a782-8016-489d-932b-ac79d29587bd', 'serial': '1e60a782-8016-489d-932b-ac79d29587bd'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '1fbbb6d2-fc0e-46df-8234-cf857926f2e6', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Skipping network cache update for instance because it is Building. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 21:47:41 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:47:41 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUSxdouP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:47:41 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:47:41 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:47:41 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[af63522b-c436-4e35-8033-9c0b562cab63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:47:41 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cb1329-d3f2-491a-9594-70ffb37f6929]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd] added
Aug 15 21:47:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[33031d93-cc1c-4def-98bc-552e8f9e511c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7fc321-9431-418c-9a15-683e43e9bbfd]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUSxdouP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nUSxdouP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04f39b9-2b04-45c7-8ace-109a0b3888d3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nUSxdouP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5e55c-3d7b-4907-b748-b72724ac46df]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d35c5-4d3c-4b02-9381-9b5394007090]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:47:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:47:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11acb5a-a887-470e-bd21-d020b3688c4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260]
Aug 15 21:47:41 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260] successful.
Aug 15 21:47:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb55f59-6645-4605-8b86-206667111900]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:47:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b697c6-ea8a-465d-b68e-857fa34167fb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:47:42 user nova-compute[72992]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd (non-flash)
Aug 15 21:47:42 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:47:42 user nova-compute[72992]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd (non-flash)
Aug 15 21:47:42 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff85ca4-2dbe-42cf-8838-f76f41dcaa93]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUSxdouP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23639613835646237', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639613835646237', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-25758967',display_name='tempest-TestVolumeBootPattern-server-25758967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-25758967',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-jht0vdb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:47:27Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=88d291f1-bd1d-43c2-9888-4d6ac16b33c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:71:c2,bridge_name='br-int',has_traffic_filtering=True,id=f3c39ec3-3b75-43aa-a638-060fc358fd05,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c39ec3-3b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.objects.instance [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'pci_devices' on Instance uuid 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:47:43 user nova-compute[72992]:   <uuid>88d291f1-bd1d-43c2-9888-4d6ac16b33c6</uuid>
Aug 15 21:47:43 user nova-compute[72992]:   <name>instance-0000002f</name>
Aug 15 21:47:43 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:47:43 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:47:43 user nova-compute[72992]:   <metadata>
Aug 15 21:47:43 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:47:43 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:47:43 user nova-compute[72992]:       <nova:name>tempest-TestVolumeBootPattern-server-25758967</nova:name>
Aug 15 21:47:43 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:47:41</nova:creationTime>
Aug 15 21:47:43 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:47:43 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:47:43 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:47:43 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:47:43 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:47:43 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:47:43 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:47:43 user nova-compute[72992]:       <nova:owner>
Aug 15 21:47:43 user nova-compute[72992]:         <nova:user uuid="68ac4abe94f1400c9ffc2dc1e7725253">tempest-TestVolumeBootPattern-6524685-project-member</nova:user>
Aug 15 21:47:43 user nova-compute[72992]:         <nova:project uuid="1bb04a16dcfc4270a451facd41d87968">tempest-TestVolumeBootPattern-6524685</nova:project>
Aug 15 21:47:43 user nova-compute[72992]:       </nova:owner>
Aug 15 21:47:43 user nova-compute[72992]:       <nova:ports>
Aug 15 21:47:43 user nova-compute[72992]:         <nova:port uuid="f3c39ec3-3b75-43aa-a638-060fc358fd05">
Aug 15 21:47:43 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 21:47:43 user nova-compute[72992]:         </nova:port>
Aug 15 21:47:43 user nova-compute[72992]:       </nova:ports>
Aug 15 21:47:43 user nova-compute[72992]:     </nova:instance>
Aug 15 21:47:43 user nova-compute[72992]:   </metadata>
Aug 15 21:47:43 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:47:43 user nova-compute[72992]:     <system>
Aug 15 21:47:43 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:47:43 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:47:43 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:47:43 user nova-compute[72992]:       <entry name="serial">88d291f1-bd1d-43c2-9888-4d6ac16b33c6</entry>
Aug 15 21:47:43 user nova-compute[72992]:       <entry name="uuid">88d291f1-bd1d-43c2-9888-4d6ac16b33c6</entry>
Aug 15 21:47:43 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:47:43 user nova-compute[72992]:     </system>
Aug 15 21:47:43 user nova-compute[72992]:   </sysinfo>
Aug 15 21:47:43 user nova-compute[72992]:   <os>
Aug 15 21:47:43 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:47:43 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:47:43 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:47:43 user nova-compute[72992]:   </os>
Aug 15 21:47:43 user nova-compute[72992]:   <features>
Aug 15 21:47:43 user nova-compute[72992]:     <acpi/>
Aug 15 21:47:43 user nova-compute[72992]:     <apic/>
Aug 15 21:47:43 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:47:43 user nova-compute[72992]:   </features>
Aug 15 21:47:43 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:47:43 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:47:43 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:47:43 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:47:43 user nova-compute[72992]:   </clock>
Aug 15 21:47:43 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:47:43 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:47:43 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:47:43 user nova-compute[72992]:   </cpu>
Aug 15 21:47:43 user nova-compute[72992]:   <devices>
Aug 15 21:47:43 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:47:43 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:47:43 user nova-compute[72992]:       <source dev="/dev/sdc"/>
Aug 15 21:47:43 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:47:43 user nova-compute[72992]:       <serial>1e60a782-8016-489d-932b-ac79d29587bd</serial>
Aug 15 21:47:43 user nova-compute[72992]:     </disk>
Aug 15 21:47:43 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:47:43 user nova-compute[72992]:       <mac address="fa:16:3e:99:71:c2"/>
Aug 15 21:47:43 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:47:43 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:47:43 user nova-compute[72992]:       <target dev="tapf3c39ec3-3b"/>
Aug 15 21:47:43 user nova-compute[72992]:     </interface>
Aug 15 21:47:43 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:47:43 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/88d291f1-bd1d-43c2-9888-4d6ac16b33c6/console.log" append="off"/>
Aug 15 21:47:43 user nova-compute[72992]:     </serial>
Aug 15 21:47:43 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:47:43 user nova-compute[72992]:     <video>
Aug 15 21:47:43 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:47:43 user nova-compute[72992]:     </video>
Aug 15 21:47:43 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:47:43 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:47:43 user nova-compute[72992]:     </rng>
Aug 15 21:47:43 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:47:43 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:47:43 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:47:43 user nova-compute[72992]:     </memballoon>
Aug 15 21:47:43 user nova-compute[72992]:   </devices>
Aug 15 21:47:43 user nova-compute[72992]: </domain>
Aug 15 21:47:43 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-25758967',display_name='tempest-TestVolumeBootPattern-server-25758967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-25758967',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-jht0vdb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:47:27Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=88d291f1-bd1d-43c2-9888-4d6ac16b33c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:71:c2,bridge_name='br-int',has_traffic_filtering=True,id=f3c39ec3-3b75-43aa-a638-060fc358fd05,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c39ec3-3b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG os_vif [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:71:c2,bridge_name='br-int',has_traffic_filtering=True,id=f3c39ec3-3b75-43aa-a638-060fc358fd05,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c39ec3-3b') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3c39ec3-3b, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3c39ec3-3b, col_values=(('external_ids', {'iface-id': 'f3c39ec3-3b75-43aa-a638-060fc358fd05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:71:c2', 'vm-uuid': '88d291f1-bd1d-43c2-9888-4d6ac16b33c6'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:43 user nova-compute[72992]: INFO os_vif [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:71:c2,bridge_name='br-int',has_traffic_filtering=True,id=f3c39ec3-3b75-43aa-a638-060fc358fd05,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c39ec3-3b')
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:47:43 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No VIF found with MAC fa:16:3e:99:71:c2, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-f73a9c1c-97fe-4817-96b6-084abea02530 req-faaa48ea-2f95-470a-90fe-6f696d13ef41 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received event network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f73a9c1c-97fe-4817-96b6-084abea02530 req-faaa48ea-2f95-470a-90fe-6f696d13ef41 service nova] Acquiring lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f73a9c1c-97fe-4817-96b6-084abea02530 req-faaa48ea-2f95-470a-90fe-6f696d13ef41 service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-f73a9c1c-97fe-4817-96b6-084abea02530 req-faaa48ea-2f95-470a-90fe-6f696d13ef41 service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG nova.compute.manager [req-f73a9c1c-97fe-4817-96b6-084abea02530 req-faaa48ea-2f95-470a-90fe-6f696d13ef41 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] No waiting events found dispatching network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:47:44 user nova-compute[72992]: WARNING nova.compute.manager [req-f73a9c1c-97fe-4817-96b6-084abea02530 req-faaa48ea-2f95-470a-90fe-6f696d13ef41 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received unexpected event network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 for instance with vm_state building and task_state spawning.
Aug 15 21:47:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136066.5170743, 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:47:46 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] VM Resumed (Lifecycle Event)
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:47:46 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Instance spawned successfully.
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:47:46 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136066.5185206, 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:47:46 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] VM Started (Lifecycle Event)
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-465693a1-ac40-4bf5-a8d9-7413a0be4115 req-7dc4aab3-02cf-49d5-874f-3bce289ded1d service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received event network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-465693a1-ac40-4bf5-a8d9-7413a0be4115 req-7dc4aab3-02cf-49d5-874f-3bce289ded1d service nova] Acquiring lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-465693a1-ac40-4bf5-a8d9-7413a0be4115 req-7dc4aab3-02cf-49d5-874f-3bce289ded1d service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-465693a1-ac40-4bf5-a8d9-7413a0be4115 req-7dc4aab3-02cf-49d5-874f-3bce289ded1d service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [req-465693a1-ac40-4bf5-a8d9-7413a0be4115 req-7dc4aab3-02cf-49d5-874f-3bce289ded1d service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] No waiting events found dispatching network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:47:46 user nova-compute[72992]: WARNING nova.compute.manager [req-465693a1-ac40-4bf5-a8d9-7413a0be4115 req-7dc4aab3-02cf-49d5-874f-3bce289ded1d service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received unexpected event network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 for instance with vm_state building and task_state spawning.
Aug 15 21:47:46 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:47:46 user nova-compute[72992]: INFO nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 15 21:47:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:47:46 user nova-compute[72992]: INFO nova.compute.manager [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Took 20.15 seconds to build instance.
Aug 15 21:47:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-2ca7b7bb-f433-46c2-8c9d-81fa195f4121 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.236s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:47:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:47:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:47:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:48:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:34 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:48:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:48:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:48:36 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:48:36 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:48:37 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:48:37 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8668MB free_disk=25.352001190185547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:48:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:48:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:48:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:48:42 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:48:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:48:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:48:42 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:48:42 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [{"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-286b36d1-01e5-42f8-bb6e-9adaf5879d5d" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:48:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:48:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:48:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Verify base images {{(pid=72992) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72992) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Image id ca16bfd3-6680-457d-af6e-aad43cd3fadd yields fingerprint 0d1fc423a213fc4789ca293b958cbd4c92269e6d {{(pid=72992) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] image ca16bfd3-6680-457d-af6e-aad43cd3fadd at (/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d): checking
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] image ca16bfd3-6680-457d-af6e-aad43cd3fadd at (/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d): image is in use {{(pid=72992) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 is a valid instance name {{(pid=72992) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] 286b36d1-01e5-42f8-bb6e-9adaf5879d5d is a valid instance name {{(pid=72992) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] 286b36d1-01e5-42f8-bb6e-9adaf5879d5d has a disk file {{(pid=72992) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d is backed by 0d1fc423a213fc4789ca293b958cbd4c92269e6d {{(pid=72992) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc
Aug 15 21:48:57 user nova-compute[72992]: WARNING nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Unknown base file: /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Active base files: /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Removable base files: /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79 /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26 /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84 /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6e58d08902cfed8967ebb87d1b92cd9610ccbd79
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c3922a97e650e675ddbe1b595eb3f692d1b58e26
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b5d6ba2d6721b765e9097b4898e6cbb84c29ff84
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b78397bf7bec2a57b324a383ebbfcafc342e1ddf
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e20b165265c9f11423f11d3b9203c98a056f848b
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/48d3349cf1be8deaf9941796827a50f2755b78da
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0b99bec7e256a7ee39b63bc2bcc781e9edc8a9bf
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/11a9f951d8b49d954882a1b95cbd9e7493bb1cfc
Aug 15 21:48:57 user nova-compute[72992]: INFO nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57043fc3a338f26cd74f049ab35953200c283dcf
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Verification complete {{(pid=72992) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Verify swap images {{(pid=72992) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 21:48:57 user nova-compute[72992]: DEBUG nova.virt.libvirt.imagecache [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Verify ephemeral images {{(pid=72992) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 21:48:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:48:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:48:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:48:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:48:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:49:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:49:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:17 user nova-compute[72992]: INFO nova.compute.manager [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Terminating instance
Aug 15 21:49:17 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-1a05c825-6575-42fe-9e4f-cbf0bdde494d req-de134b59-b443-4fc3-ad5d-9658301ba8cf service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received event network-vif-unplugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1a05c825-6575-42fe-9e4f-cbf0bdde494d req-de134b59-b443-4fc3-ad5d-9658301ba8cf service nova] Acquiring lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1a05c825-6575-42fe-9e4f-cbf0bdde494d req-de134b59-b443-4fc3-ad5d-9658301ba8cf service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1a05c825-6575-42fe-9e4f-cbf0bdde494d req-de134b59-b443-4fc3-ad5d-9658301ba8cf service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-1a05c825-6575-42fe-9e4f-cbf0bdde494d req-de134b59-b443-4fc3-ad5d-9658301ba8cf service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] No waiting events found dispatching network-vif-unplugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-1a05c825-6575-42fe-9e4f-cbf0bdde494d req-de134b59-b443-4fc3-ad5d-9658301ba8cf service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received event network-vif-unplugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:18 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Instance destroyed successfully.
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'resources' on Instance uuid 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-25758967',display_name='tempest-TestVolumeBootPattern-server-25758967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-25758967',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:47:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-jht0vdb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:47:47Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=88d291f1-bd1d-43c2-9888-4d6ac16b33c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "address": "fa:16:3e:99:71:c2", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c39ec3-3b", "ovs_interfaceid": "f3c39ec3-3b75-43aa-a638-060fc358fd05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:71:c2,bridge_name='br-int',has_traffic_filtering=True,id=f3c39ec3-3b75-43aa-a638-060fc358fd05,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c39ec3-3b') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_vif [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:71:c2,bridge_name='br-int',has_traffic_filtering=True,id=f3c39ec3-3b75-43aa-a638-060fc358fd05,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c39ec3-3b') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3c39ec3-3b, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:18 user nova-compute[72992]: INFO os_vif [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:71:c2,bridge_name='br-int',has_traffic_filtering=True,id=f3c39ec3-3b75-43aa-a638-060fc358fd05,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c39ec3-3b')
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nUSxdouP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:49:18 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57076acd-46ba-48aa-9e7c-d8326b44fe17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ec43eb-fc69-44e0-875a-956401fa94d2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:49:18 user nova-compute[72992]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd (non-flash)
Aug 15 21:49:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:49:18 user nova-compute[72992]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd (non-flash)
Aug 15 21:49:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c8cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2a51b2-4840-4e4e-9659-8e0e2d964749]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae990e-8e11-48f5-8af1-b6b4fe9b833c]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fc5ac6-e4fc-462e-a8c4-204617d78483]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b5ba0e-f130-4d47-b93a-3cedc18f09fc]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23639613835646237', '/dev/disk/by-id/scsi-1SCST_BIOc4a01500-69a85db72bf0bc22', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c4a01500') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[397e14ee-eee0-4f60-a874-17971dcac689]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc7390-9d1d-4ecd-b5b0-9d3045baeaf8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ef53d-ede4-44a2-8d05-7651268d2db8]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260]
Aug 15 21:49:18 user nova-compute[72992]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd, portal: 172.16.0.220,3260] successful.
Aug 15 21:49:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e60a782-8016-489d-932b-ac79d29587bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62372b9a-ad53-4a1c-a2ed-945a70e0f7ce]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== disconnect_volume: return (294ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:49:18 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Deleting instance files /opt/stack/data/nova/instances/88d291f1-bd1d-43c2-9888-4d6ac16b33c6_del
Aug 15 21:49:18 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Deletion of /opt/stack/data/nova/instances/88d291f1-bd1d-43c2-9888-4d6ac16b33c6_del complete
Aug 15 21:49:18 user nova-compute[72992]: INFO nova.compute.manager [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 15 21:49:18 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:49:18 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:49:19 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:49:19 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Took 0.52 seconds to deallocate network for instance.
Aug 15 21:49:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-308e653f-8185-4116-8201-beaf005b0221 req-76f239bc-bebe-4fe1-a5f2-9bb3104c2eb1 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received event network-vif-deleted-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:19 user nova-compute[72992]: INFO nova.compute.manager [req-308e653f-8185-4116-8201-beaf005b0221 req-76f239bc-bebe-4fe1-a5f2-9bb3104c2eb1 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Neutron deleted interface f3c39ec3-3b75-43aa-a638-060fc358fd05; detaching it from the instance and deleting it from the info cache
Aug 15 21:49:19 user nova-compute[72992]: DEBUG nova.network.neutron [req-308e653f-8185-4116-8201-beaf005b0221 req-76f239bc-bebe-4fe1-a5f2-9bb3104c2eb1 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:49:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-308e653f-8185-4116-8201-beaf005b0221 req-76f239bc-bebe-4fe1-a5f2-9bb3104c2eb1 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Detach interface failed, port_id=f3c39ec3-3b75-43aa-a638-060fc358fd05, reason: Instance 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:49:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-ac2d27d6-bb19-4c99-980f-48154bc9b3c5 req-4b5a5158-f6d4-448c-ac57-2d113fc028a3 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received event network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ac2d27d6-bb19-4c99-980f-48154bc9b3c5 req-4b5a5158-f6d4-448c-ac57-2d113fc028a3 service nova] Acquiring lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ac2d27d6-bb19-4c99-980f-48154bc9b3c5 req-4b5a5158-f6d4-448c-ac57-2d113fc028a3 service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-ac2d27d6-bb19-4c99-980f-48154bc9b3c5 req-4b5a5158-f6d4-448c-ac57-2d113fc028a3 service nova] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-ac2d27d6-bb19-4c99-980f-48154bc9b3c5 req-4b5a5158-f6d4-448c-ac57-2d113fc028a3 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] No waiting events found dispatching network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:19 user nova-compute[72992]: WARNING nova.compute.manager [req-ac2d27d6-bb19-4c99-980f-48154bc9b3c5 req-4b5a5158-f6d4-448c-ac57-2d113fc028a3 service nova] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Received unexpected event network-vif-plugged-f3c39ec3-3b75-43aa-a638-060fc358fd05 for instance with vm_state active and task_state deleting.
Aug 15 21:49:19 user nova-compute[72992]: INFO nova.compute.manager [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Took 0.81 seconds to detach 1 volumes for instance.
Aug 15 21:49:19 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Deleting volume: 1e60a782-8016-489d-932b-ac79d29587bd {{(pid=72992) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 21:49:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:20 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:49:20 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:49:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:20 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Deleted allocations for instance 88d291f1-bd1d-43c2-9888-4d6ac16b33c6
Aug 15 21:49:20 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6bf23ca0-3f15-4114-9da2-64addccb4864 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "88d291f1-bd1d-43c2-9888-4d6ac16b33c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:32 user nova-compute[72992]: INFO nova.compute.manager [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Terminating instance
Aug 15 21:49:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-5f14815a-d26b-47d6-b57e-725955a71574 req-12458d84-a5a5-4df6-a9e0-1ff9c5026d95 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5f14815a-d26b-47d6-b57e-725955a71574 req-12458d84-a5a5-4df6-a9e0-1ff9c5026d95 service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5f14815a-d26b-47d6-b57e-725955a71574 req-12458d84-a5a5-4df6-a9e0-1ff9c5026d95 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-5f14815a-d26b-47d6-b57e-725955a71574 req-12458d84-a5a5-4df6-a9e0-1ff9c5026d95 service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-5f14815a-d26b-47d6-b57e-725955a71574 req-12458d84-a5a5-4df6-a9e0-1ff9c5026d95 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.compute.manager [req-5f14815a-d26b-47d6-b57e-725955a71574 req-12458d84-a5a5-4df6-a9e0-1ff9c5026d95 service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692136158.2067533, 88d291f1-bd1d-43c2-9888-4d6ac16b33c6 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:49:33 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] VM Stopped (Lifecycle Event)
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a2165b01-63e9-4b55-bbe7-008d1dd4755c None None] [instance: 88d291f1-bd1d-43c2-9888-4d6ac16b33c6] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Instance destroyed successfully.
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lazy-loading 'resources' on Instance uuid 286b36d1-01e5-42f8-bb6e-9adaf5879d5d {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1065318765',display_name='tempest-ServerActionsTestOtherB-server-1065318765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1065318765',id=46,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPncgatVK/x7wNuZ2AjZcGqgeYHGFy1NId0HTiKosE+GbPqYHUS2zj3befl9AuiZGCj1k/riT5coxbq8p8rvKVhRPC4QTIP0IVVPwOZjyw4/4uIQl1iSsC2lmPiNwdvf8g==',key_name='tempest-keypair-1394478370',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ddb321608a94ff7b8b16e55bcb704e1',ramdisk_id='',reservation_id='r-wsnvsfts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1658679857',owner_user_name='tempest-ServerActionsTestOtherB-1658679857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='850b33c8246e4cab9bd85d289f26cc95',uuid=286b36d1-01e5-42f8-bb6e-9adaf5879d5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converting VIF {"id": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "address": "fa:16:3e:70:37:5f", "network": {"id": "1bfb58c1-7015-43c7-b4df-29545f0ecc58", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1737778629-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ddb321608a94ff7b8b16e55bcb704e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c1ffed-2f", "ovs_interfaceid": "26c1ffed-2f62-4a2d-8250-b065e4003ee3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_vif [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c1ffed-2f, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:49:33 user nova-compute[72992]: INFO os_vif [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:37:5f,bridge_name='br-int',has_traffic_filtering=True,id=26c1ffed-2f62-4a2d-8250-b065e4003ee3,network=Network(1bfb58c1-7015-43c7-b4df-29545f0ecc58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c1ffed-2f')
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yReLJwua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:49:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a02c642-76a4-470a-a9b9-90026f7a198a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d6432d-92c2-48b1-8505-041f34f1aeed]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:49:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 (non-flash)
Aug 15 21:49:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c88433e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c66d70-c561-4530-8d75-c2faccbb2b18]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0daae73-00d8-4129-9a47-554ef2520e36]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18622c9-1d39-4602-8d4e-e8f0b68f88be]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b8e09-3a3f-492a-9ea4-48e56963abad]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19845dd-3e3d-4c2e-9759-fa21b5e49930]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[35818a07-ac30-421c-8d1f-218305c5bbc4]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260]
Aug 15 21:49:33 user nova-compute[72992]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752, portal: 172.16.0.220,3260] successful.
Aug 15 21:49:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96177028-14de-4534-aeec-10630a6e8752 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c3af51-d18d-40ea-a0db-992ee7dba760]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] <== disconnect_volume: return (275ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:49:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Deleting instance files /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d_del
Aug 15 21:49:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Deletion of /opt/stack/data/nova/instances/286b36d1-01e5-42f8-bb6e-9adaf5879d5d_del complete
Aug 15 21:49:33 user nova-compute[72992]: INFO nova.compute.manager [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 15 21:49:33 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:49:33 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:49:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:49:35 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Took 1.12 seconds to deallocate network for instance.
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:35 user nova-compute[72992]: WARNING nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state deleting.
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:35 user nova-compute[72992]: WARNING nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state deleting.
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:35 user nova-compute[72992]: WARNING nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state deleting.
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-unplugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Acquiring lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] No waiting events found dispatching network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:49:35 user nova-compute[72992]: WARNING nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received unexpected event network-vif-plugged-26c1ffed-2f62-4a2d-8250-b065e4003ee3 for instance with vm_state active and task_state deleting.
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-1aa818f4-700b-4eb1-860d-299c04c2c210 req-404fe1e6-454b-433f-bd0f-c9af23deb30c service nova] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Received event network-vif-deleted-26c1ffed-2f62-4a2d-8250-b065e4003ee3 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:35 user nova-compute[72992]: INFO nova.compute.manager [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:49:35 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:49:36 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:49:36 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:49:36 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:49:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:36 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Deleted allocations for instance 286b36d1-01e5-42f8-bb6e-9adaf5879d5d
Aug 15 21:49:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-b920def0-7e0f-4d7c-a73c-dcd0b7072a63 tempest-ServerActionsTestOtherB-1658679857 tempest-ServerActionsTestOtherB-1658679857-project-member] Lock "286b36d1-01e5-42f8-bb6e-9adaf5879d5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.492s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:37 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:49:38 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:49:38 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:49:38 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.37109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:49:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:49:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:49:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:49:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692136173.5035613, 286b36d1-01e5-42f8-bb6e-9adaf5879d5d => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:49:48 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] VM Stopped (Lifecycle Event)
Aug 15 21:49:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6851a7e1-4808-4fa9-926a-0eb31ddf567a None None] [instance: 286b36d1-01e5-42f8-bb6e-9adaf5879d5d] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:48 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:49:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:49:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:49:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:49:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:49:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:56 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:49:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:49:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:50:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:50:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:50:08 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:50:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:50:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:50:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:25 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:50:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:50:30 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:50:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:50:30 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:50:30 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:50:30 user nova-compute[72992]: INFO nova.compute.claims [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Claim successful on node user
Aug 15 21:50:30 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.189s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:50:31 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.policy [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ac4abe94f1400c9ffc2dc1e7725253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb04a16dcfc4270a451facd41d87968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:50:31 user nova-compute[72992]: INFO nova.virt.block_device [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Booting with volume ed274e6c-0624-421e-9017-cd4bf5edf037 at /dev/vda
Aug 15 21:50:31 user nova-compute[72992]: DEBUG os_brick.utils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d892ec7-414d-4fc3-b7c7-8a006d004963]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc93b2-a05d-4a0d-b443-227e08d50351]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[12023cb6-85b3-459f-95ad-172f982cd4b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9d1dec-9f1a-4468-8211-0c2f44587ac5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:50:31 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:50:31 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5355067d-71a3-4f1b-80b2-43348da7e0ab]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG os_brick.utils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating existing volume attachment record: 88755bb7-54f3-4135-a16e-86d1a6f81b72 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:50:31 user nova-compute[72992]: DEBUG nova.network.neutron [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Successfully created port: 699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG nova.network.neutron [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Successfully updated port: 699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquired lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG nova.network.neutron [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG nova.network.neutron [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-changed-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Refreshing instance network info cache due to event network-changed-699483fb-0a0e-4053-9e53-834d5d6a6417. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:50:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] Acquiring lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG nova.network.neutron [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Releasing lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Instance network_info: |[{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] Acquired lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Refreshing network info cache for port 699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updated VIF entry in instance network info cache for port 699483fb-0a0e-4053-9e53-834d5d6a6417. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG nova.network.neutron [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:50:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-651bbe5c-749d-40e8-92f6-c4613975133d req-146ba162-6327-4f25-8b3f-9224e51bc6e2 service nova] Releasing lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:50:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:38 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:38 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:50:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:50:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:50:38 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:50:39 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:50:39 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:50:39 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=25.369243621826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b35c86b9-9d38-4019-81e8-a05c4185d5c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:50:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:50:40 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Creating image(s)
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Ensure instance console log exists: /opt/stack/data/nova/instances/b35c86b9-9d38-4019-81e8-a05c4185d5c0/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Start _get_guest_xml network_info=[{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofQuVDHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b35c86b9-9d38-4019-81e8-a05c4185d5c0', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed274e6c-0624-421e-9017-cd4bf5edf037', 'serial': 'ed274e6c-0624-421e-9017-cd4bf5edf037'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '88755bb7-54f3-4135-a16e-86d1a6f81b72', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:50:40 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:50:40 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofQuVDHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:50:40 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:50:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:50:40 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:50:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:50:40 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca3a5a-c151-4abf-9458-1dbcba301dfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:50:40 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd19903d-831d-4826-8bba-917d755ad093]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037] added
Aug 15 21:50:40 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5073657a-6b51-4b39-b1ca-503f9ab915ff]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ba273-5bd9-479b-9ac0-959eabd5881f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofQuVDHO {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofQuVDHO" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[83826f77-6800-46a8-bb48-f42b58c41027]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ofQuVDHO'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5253935-3fef-4ead-8ffc-93c5c52e1beb]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80666f96-8352-4c18-8163-52c23469de06]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:50:41 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:50:41 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:50:41 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:50:41 user nova-compute[72992]: 
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf579e5-bfcb-4031-9b08-545d3257e173]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260]
Aug 15 21:50:41 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260] successful.
Aug 15 21:50:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c4e627-eff6-48ca-b2d9-016c0a7df9a8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec94cce6-3f9f-41f9-8920-0b22105d0844]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:50:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:50:41 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c7f72e-e8e5-4547-bff2-7526c914e69d]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:50:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofQuVDHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26431343866393832', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431343866393832', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1976933895',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1976933895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1976933895',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHqiIStrvdVH43XwGjIBI1mQVktQGgyWDQamXVEuKYKl3xjj+tpeaMvdcsX+mprBs6fAsjN0csfL9C4RzU11nOiMywDcKAX2EknkhPtc3tQlIKbE5BVo78B1MgpEQRcTg==',key_name='tempest-keypair-796883223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-bdzvjoal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=b35c86b9-9d38-4019-81e8-a05c4185d5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:9f,bridge_name='br-int',has_traffic_filtering=True,id=699483fb-0a0e-4053-9e53-834d5d6a6417,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699483fb-0a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.objects.instance [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'pci_devices' on Instance uuid b35c86b9-9d38-4019-81e8-a05c4185d5c0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:50:42 user nova-compute[72992]:   <uuid>b35c86b9-9d38-4019-81e8-a05c4185d5c0</uuid>
Aug 15 21:50:42 user nova-compute[72992]:   <name>instance-00000030</name>
Aug 15 21:50:42 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:50:42 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:50:42 user nova-compute[72992]:   <metadata>
Aug 15 21:50:42 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:50:42 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:50:42 user nova-compute[72992]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1976933895</nova:name>
Aug 15 21:50:42 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:50:40</nova:creationTime>
Aug 15 21:50:42 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:50:42 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:50:42 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:50:42 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:50:42 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:50:42 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:50:42 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:50:42 user nova-compute[72992]:       <nova:owner>
Aug 15 21:50:42 user nova-compute[72992]:         <nova:user uuid="68ac4abe94f1400c9ffc2dc1e7725253">tempest-TestVolumeBootPattern-6524685-project-member</nova:user>
Aug 15 21:50:42 user nova-compute[72992]:         <nova:project uuid="1bb04a16dcfc4270a451facd41d87968">tempest-TestVolumeBootPattern-6524685</nova:project>
Aug 15 21:50:42 user nova-compute[72992]:       </nova:owner>
Aug 15 21:50:42 user nova-compute[72992]:       <nova:ports>
Aug 15 21:50:42 user nova-compute[72992]:         <nova:port uuid="699483fb-0a0e-4053-9e53-834d5d6a6417">
Aug 15 21:50:42 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 21:50:42 user nova-compute[72992]:         </nova:port>
Aug 15 21:50:42 user nova-compute[72992]:       </nova:ports>
Aug 15 21:50:42 user nova-compute[72992]:     </nova:instance>
Aug 15 21:50:42 user nova-compute[72992]:   </metadata>
Aug 15 21:50:42 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:50:42 user nova-compute[72992]:     <system>
Aug 15 21:50:42 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:50:42 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:50:42 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:50:42 user nova-compute[72992]:       <entry name="serial">b35c86b9-9d38-4019-81e8-a05c4185d5c0</entry>
Aug 15 21:50:42 user nova-compute[72992]:       <entry name="uuid">b35c86b9-9d38-4019-81e8-a05c4185d5c0</entry>
Aug 15 21:50:42 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:50:42 user nova-compute[72992]:     </system>
Aug 15 21:50:42 user nova-compute[72992]:   </sysinfo>
Aug 15 21:50:42 user nova-compute[72992]:   <os>
Aug 15 21:50:42 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:50:42 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:50:42 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:50:42 user nova-compute[72992]:   </os>
Aug 15 21:50:42 user nova-compute[72992]:   <features>
Aug 15 21:50:42 user nova-compute[72992]:     <acpi/>
Aug 15 21:50:42 user nova-compute[72992]:     <apic/>
Aug 15 21:50:42 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:50:42 user nova-compute[72992]:   </features>
Aug 15 21:50:42 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:50:42 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:50:42 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:50:42 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:50:42 user nova-compute[72992]:   </clock>
Aug 15 21:50:42 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:50:42 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:50:42 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:50:42 user nova-compute[72992]:   </cpu>
Aug 15 21:50:42 user nova-compute[72992]:   <devices>
Aug 15 21:50:42 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:50:42 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:50:42 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:50:42 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:50:42 user nova-compute[72992]:       <serial>ed274e6c-0624-421e-9017-cd4bf5edf037</serial>
Aug 15 21:50:42 user nova-compute[72992]:     </disk>
Aug 15 21:50:42 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:50:42 user nova-compute[72992]:       <mac address="fa:16:3e:5a:6e:9f"/>
Aug 15 21:50:42 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:50:42 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:50:42 user nova-compute[72992]:       <target dev="tap699483fb-0a"/>
Aug 15 21:50:42 user nova-compute[72992]:     </interface>
Aug 15 21:50:42 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:50:42 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/b35c86b9-9d38-4019-81e8-a05c4185d5c0/console.log" append="off"/>
Aug 15 21:50:42 user nova-compute[72992]:     </serial>
Aug 15 21:50:42 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:50:42 user nova-compute[72992]:     <video>
Aug 15 21:50:42 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:50:42 user nova-compute[72992]:     </video>
Aug 15 21:50:42 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:50:42 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:50:42 user nova-compute[72992]:     </rng>
Aug 15 21:50:42 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:50:42 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:50:42 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:50:42 user nova-compute[72992]:     </memballoon>
Aug 15 21:50:42 user nova-compute[72992]:   </devices>
Aug 15 21:50:42 user nova-compute[72992]: </domain>
Aug 15 21:50:42 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1976933895',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1976933895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1976933895',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHqiIStrvdVH43XwGjIBI1mQVktQGgyWDQamXVEuKYKl3xjj+tpeaMvdcsX+mprBs6fAsjN0csfL9C4RzU11nOiMywDcKAX2EknkhPtc3tQlIKbE5BVo78B1MgpEQRcTg==',key_name='tempest-keypair-796883223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-bdzvjoal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=b35c86b9-9d38-4019-81e8-a05c4185d5c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:9f,bridge_name='br-int',has_traffic_filtering=True,id=699483fb-0a0e-4053-9e53-834d5d6a6417,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699483fb-0a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG os_vif [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:9f,bridge_name='br-int',has_traffic_filtering=True,id=699483fb-0a0e-4053-9e53-834d5d6a6417,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699483fb-0a') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap699483fb-0a, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap699483fb-0a, col_values=(('external_ids', {'iface-id': '699483fb-0a0e-4053-9e53-834d5d6a6417', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:6e:9f', 'vm-uuid': 'b35c86b9-9d38-4019-81e8-a05c4185d5c0'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:42 user nova-compute[72992]: INFO os_vif [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:9f,bridge_name='br-int',has_traffic_filtering=True,id=699483fb-0a0e-4053-9e53-834d5d6a6417,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699483fb-0a')
Aug 15 21:50:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:50:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No VIF found with MAC fa:16:3e:5a:6e:9f, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Skipping network cache update for instance because it is Building. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-903c1661-c431-4c21-9593-f8d77d1271b2 req-9da113fe-caef-4f84-aaf3-597b69cc471c service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-903c1661-c431-4c21-9593-f8d77d1271b2 req-9da113fe-caef-4f84-aaf3-597b69cc471c service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-903c1661-c431-4c21-9593-f8d77d1271b2 req-9da113fe-caef-4f84-aaf3-597b69cc471c service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-903c1661-c431-4c21-9593-f8d77d1271b2 req-9da113fe-caef-4f84-aaf3-597b69cc471c service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:50:43 user nova-compute[72992]: DEBUG nova.compute.manager [req-903c1661-c431-4c21-9593-f8d77d1271b2 req-9da113fe-caef-4f84-aaf3-597b69cc471c service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:50:43 user nova-compute[72992]: WARNING nova.compute.manager [req-903c1661-c431-4c21-9593-f8d77d1271b2 req-9da113fe-caef-4f84-aaf3-597b69cc471c service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received unexpected event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with vm_state building and task_state spawning.
Aug 15 21:50:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136245.6645644, b35c86b9-9d38-4019-81e8-a05c4185d5c0 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:50:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] VM Resumed (Lifecycle Event)
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:50:45 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Instance spawned successfully.
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:50:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136245.667369, b35c86b9-9d38-4019-81e8-a05c4185d5c0 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:50:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] VM Started (Lifecycle Event)
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:50:45 user nova-compute[72992]: INFO nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Took 4.93 seconds to spawn the instance on the hypervisor.
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:50:45 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:50:45 user nova-compute[72992]: INFO nova.compute.manager [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Took 15.02 seconds to build instance.
Aug 15 21:50:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-25319b02-e7cb-4210-ae26-12e3ea4722d9 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.121s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a23cd0f-c165-4917-94c0-b9a91d78af20 req-51780f8a-f555-43a5-90c3-629c2b45c4a2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a23cd0f-c165-4917-94c0-b9a91d78af20 req-51780f8a-f555-43a5-90c3-629c2b45c4a2 service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a23cd0f-c165-4917-94c0-b9a91d78af20 req-51780f8a-f555-43a5-90c3-629c2b45c4a2 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a23cd0f-c165-4917-94c0-b9a91d78af20 req-51780f8a-f555-43a5-90c3-629c2b45c4a2 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:50:45 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a23cd0f-c165-4917-94c0-b9a91d78af20 req-51780f8a-f555-43a5-90c3-629c2b45c4a2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:50:45 user nova-compute[72992]: WARNING nova.compute.manager [req-8a23cd0f-c165-4917-94c0-b9a91d78af20 req-51780f8a-f555-43a5-90c3-629c2b45c4a2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received unexpected event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with vm_state active and task_state None.
Aug 15 21:50:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:50:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:50:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:50:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:50:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:51:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:51:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:51:39 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:51:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:51:40 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:51:40 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:51:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.36639404296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b35c86b9-9d38-4019-81e8-a05c4185d5c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:51:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:51:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:43 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:51:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:51:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:51:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:51:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:51:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:51:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid b35c86b9-9d38-4019-81e8-a05c4185d5c0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:51:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:51:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:51:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:51:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:51:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:51:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:52:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:52:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:52:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:52:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:52:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:52:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-changed-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:52:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Refreshing instance network info cache due to event network-changed-699483fb-0a0e-4053-9e53-834d5d6a6417. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:52:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] Acquiring lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:52:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] Acquired lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:52:21 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Refreshing network info cache for port 699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updated VIF entry in instance network info cache for port 699483fb-0a0e-4053-9e53-834d5d6a6417. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0e2ff3a-5344-4d5f-883d-258c0f58eba2 req-f6816227-ed27-4a38-b308-feb34120d0bd service nova] Releasing lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:52:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:52:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:52:33 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:52:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:52:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:52:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:52:33 user nova-compute[72992]: INFO nova.compute.claims [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Claim successful on node user
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:52:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:52:34 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:52:34 user nova-compute[72992]: INFO nova.virt.block_device [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Booting with volume snapshot 3d05093d-d00d-418d-86ad-c68da770964b at /dev/vda
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.policy [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ac4abe94f1400c9ffc2dc1e7725253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb04a16dcfc4270a451facd41d87968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:52:34 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Successfully created port: d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:52:35 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Successfully updated port: d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:52:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-changed-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:52:35 user nova-compute[72992]: DEBUG nova.compute.manager [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Refreshing instance network info cache due to event network-changed-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:52:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] Acquiring lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:52:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] Acquired lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:52:35 user nova-compute[72992]: DEBUG nova.network.neutron [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Refreshing network info cache for port d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG nova.network.neutron [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG nova.network.neutron [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8de66ca1-2578-4c7b-814c-2de7c2660ab8 req-f449ac45-44d6-497a-92bd-6b08fe268e35 service nova] Releasing lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquired lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG nova.network.neutron [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Updating instance_info_cache with network_info: [{"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Releasing lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Instance network_info: |[{"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:52:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:52:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:52:39 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:52:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:52:40 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:52:40 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.364383697509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b35c86b9-9d38-4019-81e8-a05c4185d5c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4508c79d-4cde-455d-a3a1-2aa4b569d7c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:52:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:52:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Skipping network cache update for instance because it is Building. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:52:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid b35c86b9-9d38-4019-81e8-a05c4185d5c0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG os_brick.utils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7fd066-2548-428e-b10c-ded005fa905c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f22eb69-52a1-415f-ba91-febda74ccd67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45f9ef0-a117-4b38-ad33-a4139a783dc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce89b618-7f67-404d-b4f5-8c5f223f0d4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:52:45 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cb7264-3714-4b6a-8ce9-b7bb5b3ac33e]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG os_brick.utils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Updating existing volume attachment record: e52169b3-75dc-424c-b8ab-1b6d74eec0dc {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:52:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:52:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:52:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Creating image(s)
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Ensure instance console log exists: /opt/stack/data/nova/instances/4508c79d-4cde-455d-a3a1-2aa4b569d7c8/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Start _get_guest_xml network_info=[{"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T21:52:24Z,direct_url=<?>,disk_format='qcow2',id=a1175344-c27a-4c34-bfc3-c229ee18ebc6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-695981782',owner='1bb04a16dcfc4270a451facd41d87968',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T21:52:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIReJmLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4508c79d-4cde-455d-a3a1-2aa4b569d7c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'be44794a-aec0-472c-a95c-b9b2fe80f8fa', 'serial': 'be44794a-aec0-472c-a95c-b9b2fe80f8fa'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'e52169b3-75dc-424c-b8ab-1b6d74eec0dc', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:52:54 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:52:54 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T21:52:24Z,direct_url=<?>,disk_format='qcow2',id=a1175344-c27a-4c34-bfc3-c229ee18ebc6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-695981782',owner='1bb04a16dcfc4270a451facd41d87968',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T21:52:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIReJmLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:52:54 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:52:54 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:52:54 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[134f4556-aa25-4462-9e2a-48fe22ed6047]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:52:54 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91b5d52-ce86-47ad-b4bd-5a4fbc3544ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa] added
Aug 15 21:52:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c984ec-4e2d-4b1b-b2b9-0311903cc36f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d54b85-13e3-4af4-9449-989763effdd8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIReJmLx {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIReJmLx" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[439033fb-d5ed-4e72-a2c1-b1261bde0d79]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIReJmLx'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae212ec-0485-4693-be5c-e24a54ff0c7a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca3643-ff5e-47b3-8bca-ede4c3837735]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:52:55 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:52:55 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[90478187-db77-4ee5-b421-6a440ba93ec1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260]
Aug 15 21:52:55 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260] successful.
Aug 15 21:52:55 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f93dc43-a172-4404-b80f-10c91ce89e8d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3f5b9-c06d-4729-8e70-7f93c0032ad1]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:52:55 user nova-compute[72992]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa (non-flash)
Aug 15 21:52:55 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:52:55 user nova-compute[72992]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa (non-flash)
Aug 15 21:52:55 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5db8d-b228-4b95-a259-7a204fc6e454]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:52:55 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIReJmLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26466346339623365', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466346339623365', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1957739823',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1957739823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1957739823',id=49,image_ref='a1175344-c27a-4c34-bfc3-c229ee18ebc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXoI7ZME2QlmuJCR5dEouukyH03jjtOtcYcXT7Jcf4z2Te71AG+IAyv+nlP3BazatrMBypGO4Dc3t2yUgjvLIU2RaG4xWe+aZzDVNHhcUjfkYTVOpuY5Tf848dGkfDHXQ==',key_name='tempest-keypair-2113883725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-il8ls7rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-6524685',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=4508c79d-4cde-455d-a3a1-2aa4b569d7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:d6,bridge_name='br-int',has_traffic_filtering=True,id=d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54df09d-9d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.objects.instance [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'pci_devices' on Instance uuid 4508c79d-4cde-455d-a3a1-2aa4b569d7c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:52:56 user nova-compute[72992]:   <uuid>4508c79d-4cde-455d-a3a1-2aa4b569d7c8</uuid>
Aug 15 21:52:56 user nova-compute[72992]:   <name>instance-00000031</name>
Aug 15 21:52:56 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:52:56 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:52:56 user nova-compute[72992]:   <metadata>
Aug 15 21:52:56 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:52:56 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:52:56 user nova-compute[72992]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1957739823</nova:name>
Aug 15 21:52:56 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:52:54</nova:creationTime>
Aug 15 21:52:56 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:52:56 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:52:56 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:52:56 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:52:56 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:52:56 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:52:56 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:52:56 user nova-compute[72992]:       <nova:owner>
Aug 15 21:52:56 user nova-compute[72992]:         <nova:user uuid="68ac4abe94f1400c9ffc2dc1e7725253">tempest-TestVolumeBootPattern-6524685-project-member</nova:user>
Aug 15 21:52:56 user nova-compute[72992]:         <nova:project uuid="1bb04a16dcfc4270a451facd41d87968">tempest-TestVolumeBootPattern-6524685</nova:project>
Aug 15 21:52:56 user nova-compute[72992]:       </nova:owner>
Aug 15 21:52:56 user nova-compute[72992]:       <nova:root type="image" uuid="a1175344-c27a-4c34-bfc3-c229ee18ebc6"/>
Aug 15 21:52:56 user nova-compute[72992]:       <nova:ports>
Aug 15 21:52:56 user nova-compute[72992]:         <nova:port uuid="d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c">
Aug 15 21:52:56 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 21:52:56 user nova-compute[72992]:         </nova:port>
Aug 15 21:52:56 user nova-compute[72992]:       </nova:ports>
Aug 15 21:52:56 user nova-compute[72992]:     </nova:instance>
Aug 15 21:52:56 user nova-compute[72992]:   </metadata>
Aug 15 21:52:56 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:52:56 user nova-compute[72992]:     <system>
Aug 15 21:52:56 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:52:56 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:52:56 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:52:56 user nova-compute[72992]:       <entry name="serial">4508c79d-4cde-455d-a3a1-2aa4b569d7c8</entry>
Aug 15 21:52:56 user nova-compute[72992]:       <entry name="uuid">4508c79d-4cde-455d-a3a1-2aa4b569d7c8</entry>
Aug 15 21:52:56 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:52:56 user nova-compute[72992]:     </system>
Aug 15 21:52:56 user nova-compute[72992]:   </sysinfo>
Aug 15 21:52:56 user nova-compute[72992]:   <os>
Aug 15 21:52:56 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:52:56 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:52:56 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:52:56 user nova-compute[72992]:   </os>
Aug 15 21:52:56 user nova-compute[72992]:   <features>
Aug 15 21:52:56 user nova-compute[72992]:     <acpi/>
Aug 15 21:52:56 user nova-compute[72992]:     <apic/>
Aug 15 21:52:56 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:52:56 user nova-compute[72992]:   </features>
Aug 15 21:52:56 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:52:56 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:52:56 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:52:56 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:52:56 user nova-compute[72992]:   </clock>
Aug 15 21:52:56 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:52:56 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:52:56 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:52:56 user nova-compute[72992]:   </cpu>
Aug 15 21:52:56 user nova-compute[72992]:   <devices>
Aug 15 21:52:56 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:52:56 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:52:56 user nova-compute[72992]:       <source dev="/dev/sdc"/>
Aug 15 21:52:56 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:52:56 user nova-compute[72992]:       <serial>be44794a-aec0-472c-a95c-b9b2fe80f8fa</serial>
Aug 15 21:52:56 user nova-compute[72992]:     </disk>
Aug 15 21:52:56 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:52:56 user nova-compute[72992]:       <mac address="fa:16:3e:22:aa:d6"/>
Aug 15 21:52:56 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:52:56 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:52:56 user nova-compute[72992]:       <target dev="tapd54df09d-9d"/>
Aug 15 21:52:56 user nova-compute[72992]:     </interface>
Aug 15 21:52:56 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:52:56 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/4508c79d-4cde-455d-a3a1-2aa4b569d7c8/console.log" append="off"/>
Aug 15 21:52:56 user nova-compute[72992]:     </serial>
Aug 15 21:52:56 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:52:56 user nova-compute[72992]:     <video>
Aug 15 21:52:56 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:52:56 user nova-compute[72992]:     </video>
Aug 15 21:52:56 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:52:56 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:52:56 user nova-compute[72992]:     </rng>
Aug 15 21:52:56 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:52:56 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:52:56 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:52:56 user nova-compute[72992]:     </memballoon>
Aug 15 21:52:56 user nova-compute[72992]:   </devices>
Aug 15 21:52:56 user nova-compute[72992]: </domain>
Aug 15 21:52:56 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1957739823',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1957739823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1957739823',id=49,image_ref='a1175344-c27a-4c34-bfc3-c229ee18ebc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXoI7ZME2QlmuJCR5dEouukyH03jjtOtcYcXT7Jcf4z2Te71AG+IAyv+nlP3BazatrMBypGO4Dc3t2yUgjvLIU2RaG4xWe+aZzDVNHhcUjfkYTVOpuY5Tf848dGkfDHXQ==',key_name='tempest-keypair-2113883725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-il8ls7rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-6524685',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=4508c79d-4cde-455d-a3a1-2aa4b569d7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:d6,bridge_name='br-int',has_traffic_filtering=True,id=d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54df09d-9d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG os_vif [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:d6,bridge_name='br-int',has_traffic_filtering=True,id=d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54df09d-9d') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd54df09d-9d, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd54df09d-9d, col_values=(('external_ids', {'iface-id': 'd54df09d-9d22-48b0-8c7b-fdcfd95d0c1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:aa:d6', 'vm-uuid': '4508c79d-4cde-455d-a3a1-2aa4b569d7c8'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:56 user nova-compute[72992]: INFO os_vif [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:d6,bridge_name='br-int',has_traffic_filtering=True,id=d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54df09d-9d')
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:52:56 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No VIF found with MAC fa:16:3e:22:aa:d6, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-72ec5594-dd27-455f-b3ad-5295192e1472 req-e483369b-bc3c-4433-8365-9217cfd3b483 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72ec5594-dd27-455f-b3ad-5295192e1472 req-e483369b-bc3c-4433-8365-9217cfd3b483 service nova] Acquiring lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72ec5594-dd27-455f-b3ad-5295192e1472 req-e483369b-bc3c-4433-8365-9217cfd3b483 service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-72ec5594-dd27-455f-b3ad-5295192e1472 req-e483369b-bc3c-4433-8365-9217cfd3b483 service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:52:57 user nova-compute[72992]: DEBUG nova.compute.manager [req-72ec5594-dd27-455f-b3ad-5295192e1472 req-e483369b-bc3c-4433-8365-9217cfd3b483 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] No waiting events found dispatching network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:52:57 user nova-compute[72992]: WARNING nova.compute.manager [req-72ec5594-dd27-455f-b3ad-5295192e1472 req-e483369b-bc3c-4433-8365-9217cfd3b483 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received unexpected event network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c for instance with vm_state building and task_state spawning.
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136379.6406574, 4508c79d-4cde-455d-a3a1-2aa4b569d7c8 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:52:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] VM Resumed (Lifecycle Event)
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:52:59 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Instance spawned successfully.
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:52:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136379.6418765, 4508c79d-4cde-455d-a3a1-2aa4b569d7c8 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:52:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] VM Started (Lifecycle Event)
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:52:59 user nova-compute[72992]: INFO nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:52:59 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:52:59 user nova-compute[72992]: INFO nova.compute.manager [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Took 25.92 seconds to build instance.
Aug 15 21:52:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-f122e04f-a59e-4082-92b7-c9c08c822d40 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.014s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-b437f1cc-aea3-44f6-b299-3a718b5ad7d0 req-127e4c14-0778-4868-a6ea-2a04e7d16e55 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b437f1cc-aea3-44f6-b299-3a718b5ad7d0 req-127e4c14-0778-4868-a6ea-2a04e7d16e55 service nova] Acquiring lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b437f1cc-aea3-44f6-b299-3a718b5ad7d0 req-127e4c14-0778-4868-a6ea-2a04e7d16e55 service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b437f1cc-aea3-44f6-b299-3a718b5ad7d0 req-127e4c14-0778-4868-a6ea-2a04e7d16e55 service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:52:59 user nova-compute[72992]: DEBUG nova.compute.manager [req-b437f1cc-aea3-44f6-b299-3a718b5ad7d0 req-127e4c14-0778-4868-a6ea-2a04e7d16e55 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] No waiting events found dispatching network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:52:59 user nova-compute[72992]: WARNING nova.compute.manager [req-b437f1cc-aea3-44f6-b299-3a718b5ad7d0 req-127e4c14-0778-4868-a6ea-2a04e7d16e55 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received unexpected event network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c for instance with vm_state active and task_state None.
Aug 15 21:53:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:53:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:53:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:53:42 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:53:42 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.354198455810547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b35c86b9-9d38-4019-81e8-a05c4185d5c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 4508c79d-4cde-455d-a3a1-2aa4b569d7c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:53:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:53:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:53:45 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:53:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:53:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:53:45 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:53:45 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid b35c86b9-9d38-4019-81e8-a05c4185d5c0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [{"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-b35c86b9-9d38-4019-81e8-a05c4185d5c0" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:53:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:53:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:53:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:53:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:53:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:53:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:53:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:54:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:54:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:54:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:54:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:54:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:54:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-changed-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Refreshing instance network info cache due to event network-changed-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] Acquiring lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] Acquired lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Refreshing network info cache for port d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Updated VIF entry in instance network info cache for port d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG nova.network.neutron [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Updating instance_info_cache with network_info: [{"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-501c6a27-afb4-4391-a177-ebb98c79887c req-ab387ea1-6717-40cf-a124-4753b7c73966 service nova] Releasing lock "refresh_cache-4508c79d-4cde-455d-a3a1-2aa4b569d7c8" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:54:25 user nova-compute[72992]: INFO nova.compute.manager [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Terminating instance
Aug 15 21:54:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Instance destroyed successfully.
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'resources' on Instance uuid 4508c79d-4cde-455d-a3a1-2aa4b569d7c8 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1957739823',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1957739823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1957739823',id=49,image_ref='a1175344-c27a-4c34-bfc3-c229ee18ebc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXoI7ZME2QlmuJCR5dEouukyH03jjtOtcYcXT7Jcf4z2Te71AG+IAyv+nlP3BazatrMBypGO4Dc3t2yUgjvLIU2RaG4xWe+aZzDVNHhcUjfkYTVOpuY5Tf848dGkfDHXQ==',key_name='tempest-keypair-2113883725',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:52:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-il8ls7rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-6524685',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=4508c79d-4cde-455d-a3a1-2aa4b569d7c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "address": "fa:16:3e:22:aa:d6", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd54df09d-9d", "ovs_interfaceid": "d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:aa:d6,bridge_name='br-int',has_traffic_filtering=True,id=d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54df09d-9d') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_vif [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:aa:d6,bridge_name='br-int',has_traffic_filtering=True,id=d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54df09d-9d') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd54df09d-9d, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:26 user nova-compute[72992]: INFO os_vif [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:aa:d6,bridge_name='br-int',has_traffic_filtering=True,id=d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd54df09d-9d')
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIReJmLx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:54:26 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f253c1-950b-4309-b939-aaa0c9cbf7c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeaa9a5-5f59-4bdb-b5ad-07f2fe713208]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:54:26 user nova-compute[72992]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa (non-flash)
Aug 15 21:54:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:54:26 user nova-compute[72992]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa (non-flash)
Aug 15 21:54:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64edb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41bb626-616e-4592-b3ce-5cc7cb6e8d7c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[04adb258-e7ad-4324-a9d6-99fd72a72cb6]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3219df7b-a8f2-46fa-b3a8-2a188b56afa3]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4afc02-411e-436c-9382-260db9e38f94]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_17219f70', '/dev/disk/by-id/scsi-26466346339623365', '/dev/disk/by-id/scsi-1SCST_BIO17219f70-df4c9b3e946ea6ba') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[045156ef-6ab1-48cf-a778-9fd827896ab0]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af406a3-148d-4c40-906f-f08a7a85dd82]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8af9ee-8b0d-457b-b20b-0301d4f4a50f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260]
Aug 15 21:54:26 user nova-compute[72992]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa, portal: 172.16.0.220,3260] successful.
Aug 15 21:54:26 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be44794a-aec0-472c-a95c-b9b2fe80f8fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ad37be-4b1d-4058-95c1-29c12d3a883c]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== disconnect_volume: return (314ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:54:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Deleting instance files /opt/stack/data/nova/instances/4508c79d-4cde-455d-a3a1-2aa4b569d7c8_del
Aug 15 21:54:26 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Deletion of /opt/stack/data/nova/instances/4508c79d-4cde-455d-a3a1-2aa4b569d7c8_del complete
Aug 15 21:54:26 user nova-compute[72992]: INFO nova.compute.manager [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 21:54:26 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:54:26 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-vif-unplugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] Acquiring lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] No waiting events found dispatching network-vif-unplugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-vif-unplugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] Acquiring lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:54:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] No waiting events found dispatching network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:54:27 user nova-compute[72992]: WARNING nova.compute.manager [req-b2abdd2a-cd60-44f9-a055-5033d144c029 req-d4656490-dba9-4a8e-ae79-82181f77425d service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received unexpected event network-vif-plugged-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c for instance with vm_state active and task_state deleting.
Aug 15 21:54:27 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:54:27 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Took 0.80 seconds to deallocate network for instance.
Aug 15 21:54:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:28 user nova-compute[72992]: INFO nova.compute.manager [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 21:54:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Deleting volume: be44794a-aec0-472c-a95c-b9b2fe80f8fa {{(pid=72992) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 21:54:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:54:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:54:28 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:54:28 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:54:28 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:54:28 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Deleted allocations for instance 4508c79d-4cde-455d-a3a1-2aa4b569d7c8
Aug 15 21:54:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a4bb5133-73ef-45aa-921e-caba3a528ad7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "4508c79d-4cde-455d-a3a1-2aa4b569d7c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:54:29 user nova-compute[72992]: DEBUG nova.compute.manager [req-89ea1445-b5ec-4d33-a6da-d92776566c48 req-dd89239f-409e-4705-adcc-f2f46e85f174 service nova] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Received event network-vif-deleted-d54df09d-9d22-48b0-8c7b-fdcfd95d0c1c {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:54:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692136466.3846803, 4508c79d-4cde-455d-a3a1-2aa4b569d7c8 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:54:41 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] VM Stopped (Lifecycle Event)
Aug 15 21:54:41 user nova-compute[72992]: DEBUG nova.compute.manager [None req-fa1c7b66-0315-4543-9eaa-b2577e74bec9 None None] [instance: 4508c79d-4cde-455d-a3a1-2aa4b569d7c8] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:54:41 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:54:42 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:54:42 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=25.353321075439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance b35c86b9-9d38-4019-81e8-a05c4185d5c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:54:42 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:54:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:54:46 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:54:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:54:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:54:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:54:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 21:54:51 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 21:54:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:55:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 21:55:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:21 user nova-compute[72992]: INFO nova.compute.manager [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Terminating instance
Aug 15 21:55:21 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-49d0ee68-efc4-4a40-98b2-1baf452d0a16 req-00da9fa7-b8b7-437d-9174-616f4a9d6ec2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-unplugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-49d0ee68-efc4-4a40-98b2-1baf452d0a16 req-00da9fa7-b8b7-437d-9174-616f4a9d6ec2 service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-49d0ee68-efc4-4a40-98b2-1baf452d0a16 req-00da9fa7-b8b7-437d-9174-616f4a9d6ec2 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-49d0ee68-efc4-4a40-98b2-1baf452d0a16 req-00da9fa7-b8b7-437d-9174-616f4a9d6ec2 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-49d0ee68-efc4-4a40-98b2-1baf452d0a16 req-00da9fa7-b8b7-437d-9174-616f4a9d6ec2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-unplugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG nova.compute.manager [req-49d0ee68-efc4-4a40-98b2-1baf452d0a16 req-00da9fa7-b8b7-437d-9174-616f4a9d6ec2 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-unplugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:55:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Instance destroyed successfully.
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.objects.instance [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'resources' on Instance uuid b35c86b9-9d38-4019-81e8-a05c4185d5c0 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1976933895',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1976933895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1976933895',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHqiIStrvdVH43XwGjIBI1mQVktQGgyWDQamXVEuKYKl3xjj+tpeaMvdcsX+mprBs6fAsjN0csfL9C4RzU11nOiMywDcKAX2EknkhPtc3tQlIKbE5BVo78B1MgpEQRcTg==',key_name='tempest-keypair-796883223',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-bdzvjoal',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=b35c86b9-9d38-4019-81e8-a05c4185d5c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "699483fb-0a0e-4053-9e53-834d5d6a6417", "address": "fa:16:3e:5a:6e:9f", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699483fb-0a", "ovs_interfaceid": "699483fb-0a0e-4053-9e53-834d5d6a6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:6e:9f,bridge_name='br-int',has_traffic_filtering=True,id=699483fb-0a0e-4053-9e53-834d5d6a6417,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699483fb-0a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_vif [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:6e:9f,bridge_name='br-int',has_traffic_filtering=True,id=699483fb-0a0e-4053-9e53-834d5d6a6417,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699483fb-0a') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap699483fb-0a, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:55:22 user nova-compute[72992]: INFO os_vif [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:6e:9f,bridge_name='br-int',has_traffic_filtering=True,id=699483fb-0a0e-4053-9e53-834d5d6a6417,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699483fb-0a')
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofQuVDHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:55:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b772068-15ad-4f41-bdbd-307cf25be520]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5392b446-13f2-40d3-a0fe-a7325418c81c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:55:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 (non-flash)
Aug 15 21:55:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c8f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[750d681c-1e3b-436f-b4a1-8dbb1edd994a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d30674-5aba-4325-a6c8-3c24b258194d]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f004ae7-ea2d-4ef9-9c3c-ea679685e612]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4141c321-bd94-4a48-b35f-3c0c628bca97]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObd3bad20-d148f98254bb08a3', '/dev/disk/by-id/scsi-26431343866393832', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bd3bad20') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[490dd40f-8693-495a-b5a2-0a45856e57c3]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb6b49b-c58f-40a6-9b03-86be04dde459]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a2870-b1a8-4177-8dc1-5dc019b75fe5]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260]
Aug 15 21:55:22 user nova-compute[72992]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037, portal: 172.16.0.220,3260] successful.
Aug 15 21:55:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed274e6c-0624-421e-9017-cd4bf5edf037 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1412fa66-7c45-4434-a2b8-07f187f7feef]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== disconnect_volume: return (290ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:55:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Deleting instance files /opt/stack/data/nova/instances/b35c86b9-9d38-4019-81e8-a05c4185d5c0_del
Aug 15 21:55:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Deletion of /opt/stack/data/nova/instances/b35c86b9-9d38-4019-81e8-a05c4185d5c0_del complete
Aug 15 21:55:22 user nova-compute[72992]: INFO nova.compute.manager [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 21:55:22 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-26cc1154-5cab-493d-8d64-86ff91f6c7fa req-a54b43e3-d8e9-4451-84e6-93bf63fb0677 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-deleted-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:55:23 user nova-compute[72992]: INFO nova.compute.manager [req-26cc1154-5cab-493d-8d64-86ff91f6c7fa req-a54b43e3-d8e9-4451-84e6-93bf63fb0677 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Neutron deleted interface 699483fb-0a0e-4053-9e53-834d5d6a6417; detaching it from the instance and deleting it from the info cache
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.network.neutron [req-26cc1154-5cab-493d-8d64-86ff91f6c7fa req-a54b43e3-d8e9-4451-84e6-93bf63fb0677 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:55:23 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Took 0.80 seconds to deallocate network for instance.
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-26cc1154-5cab-493d-8d64-86ff91f6c7fa req-a54b43e3-d8e9-4451-84e6-93bf63fb0677 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Detach interface failed, port_id=699483fb-0a0e-4053-9e53-834d5d6a6417, reason: Instance b35c86b9-9d38-4019-81e8-a05c4185d5c0 could not be found. {{(pid=72992) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:55:23 user nova-compute[72992]: WARNING nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received unexpected event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with vm_state active and task_state deleting.
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:55:23 user nova-compute[72992]: WARNING nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received unexpected event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with vm_state active and task_state deleting.
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:55:23 user nova-compute[72992]: WARNING nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received unexpected event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with vm_state active and task_state deleting.
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-unplugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-unplugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-unplugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Acquiring lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] No waiting events found dispatching network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:55:23 user nova-compute[72992]: WARNING nova.compute.manager [req-b543007b-c6fb-479a-ac47-2542ff8a3923 req-de6f896f-0c32-489c-a2ca-c61f170e41a4 service nova] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Received unexpected event network-vif-plugged-699483fb-0a0e-4053-9e53-834d5d6a6417 for instance with vm_state active and task_state deleting.
Aug 15 21:55:23 user nova-compute[72992]: INFO nova.compute.manager [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Took 0.71 seconds to detach 1 volumes for instance.
Aug 15 21:55:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Deleting volume: ed274e6c-0624-421e-9017-cd4bf5edf037 {{(pid=72992) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 21:55:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:24 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:55:24 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:55:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:24 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Deleted allocations for instance b35c86b9-9d38-4019-81e8-a05c4185d5c0
Aug 15 21:55:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-4f065d4b-2ff6-40f4-be59-a58a1f51357c tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "b35c86b9-9d38-4019-81e8-a05c4185d5c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.079s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:29 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:37 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692136522.0547736, b35c86b9-9d38-4019-81e8-a05c4185d5c0 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:55:37 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] VM Stopped (Lifecycle Event)
Aug 15 21:55:37 user nova-compute[72992]: DEBUG nova.compute.manager [None req-899112d3-7494-483b-8353-d1e8dd2799c0 None None] [instance: b35c86b9-9d38-4019-81e8-a05c4185d5c0] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:55:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:38 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:55:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:43 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:43 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:55:44 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:55:44 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:55:44 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.35232925415039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:55:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:55:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:55:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:55:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:55:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:55:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:55:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:55:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:55:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:56:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:56:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:56:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:56:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:56:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:56:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:56:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:56:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:56:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:56:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:56:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:56:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:56:23 user nova-compute[72992]: INFO nova.compute.claims [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Claim successful on node user
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:56:24 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:56:24 user nova-compute[72992]: INFO nova.virt.block_device [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Booting with volume 39bd3132-85e0-4a1a-8b37-2e348bb81169 at /dev/vda
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.policy [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ac4abe94f1400c9ffc2dc1e7725253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb04a16dcfc4270a451facd41d87968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG os_brick.utils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc6b0c-44b1-42c7-b237-0324013632d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d04debf-a87a-4f01-a10e-043a44cd94ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf03e11-a889-4201-b647-d057e5f30e6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22f416f-cf94-4a89-b51c-acd0fe2aecc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:56:24 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:56:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d1471-fce5-4bac-bf09-adb2194f12ca]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG os_brick.utils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updating existing volume attachment record: f27b94ba-4a6b-471a-a785-1915f4d94687 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:56:24 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Successfully created port: 5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Successfully updated port: 5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquired lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-changed-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Refreshing instance network info cache due to event network-changed-5496d042-c208-4bca-bb09-cabbbdce9258. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:56:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] Acquiring lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG nova.network.neutron [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updating instance_info_cache with network_info: [{"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Releasing lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Instance network_info: |[{"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] Acquired lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG nova.network.neutron [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Refreshing network info cache for port 5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG nova.network.neutron [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updated VIF entry in instance network info cache for port 5496d042-c208-4bca-bb09-cabbbdce9258. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG nova.network.neutron [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updating instance_info_cache with network_info: [{"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:56:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3b086615-df29-4846-8439-d1470c30c045 req-3a04ae73-c8ed-4398-8d03-916d09c0e364 service nova] Releasing lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:56:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:30 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:56:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Creating image(s)
Aug 15 21:56:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Ensure instance console log exists: /opt/stack/data/nova/instances/cb284ace-6c4c-45d8-a746-c43bbf06f7d3/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:56:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Start _get_guest_xml network_info=[{"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb284ace-6c4c-45d8-a746-c43bbf06f7d3', 'attached_at': '', 'detached_at': '', 'volume_id': '39bd3132-85e0-4a1a-8b37-2e348bb81169', 'serial': '39bd3132-85e0-4a1a-8b37-2e348bb81169'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'f27b94ba-4a6b-471a-a785-1915f4d94687', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:56:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:56:33 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:56:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:56:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:56:33 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c66d5c-99ca-48a7-bd0e-f43a4b708433]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:56:33 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[500c7db8-5a9e-48dd-8f7b-c791bcf5177f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169] added
Aug 15 21:56:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b6582e-068e-40f8-a2c1-01605b877a05]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[87444071-ef7b-45dc-be07-fd24a10fc2c6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQWKZDzA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQWKZDzA" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea109af-e1d7-422d-ac28-24d919d0de5b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQWKZDzA'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cccb3d-fb43-48d2-ac76-18f86db6f4a8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe52d5d7-effc-4807-b55e-efefa3fbb9ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:56:33 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:56:33 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:56:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:56:33 user nova-compute[72992]: 
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b7385-4e52-45f7-a433-0bca1b48ef44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]
Aug 15 21:56:33 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.
Aug 15 21:56:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a51d45-9035-40ba-8c1d-40e455455416]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cba3c4-60c9-4483-a4a0-8f9cfa212a75]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 21:56:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 21:56:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a91a16-c125-4398-b741-6e744904f040]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:56:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23633333662643130', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633333662643130', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1587495923',display_name='tempest-TestVolumeBootPattern-server-1587495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1587495923',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-cok980ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:56:24Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=cb284ace-6c4c-45d8-a746-c43bbf06f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5496d042-c208-4bca-bb09-cabbbdce9258,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496d042-c2') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.objects.instance [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'pci_devices' on Instance uuid cb284ace-6c4c-45d8-a746-c43bbf06f7d3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:56:34 user nova-compute[72992]:   <uuid>cb284ace-6c4c-45d8-a746-c43bbf06f7d3</uuid>
Aug 15 21:56:34 user nova-compute[72992]:   <name>instance-00000032</name>
Aug 15 21:56:34 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:56:34 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:56:34 user nova-compute[72992]:   <metadata>
Aug 15 21:56:34 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:56:34 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:56:34 user nova-compute[72992]:       <nova:name>tempest-TestVolumeBootPattern-server-1587495923</nova:name>
Aug 15 21:56:34 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:56:33</nova:creationTime>
Aug 15 21:56:34 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:56:34 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:56:34 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:56:34 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:56:34 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:56:34 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:56:34 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:56:34 user nova-compute[72992]:       <nova:owner>
Aug 15 21:56:34 user nova-compute[72992]:         <nova:user uuid="68ac4abe94f1400c9ffc2dc1e7725253">tempest-TestVolumeBootPattern-6524685-project-member</nova:user>
Aug 15 21:56:34 user nova-compute[72992]:         <nova:project uuid="1bb04a16dcfc4270a451facd41d87968">tempest-TestVolumeBootPattern-6524685</nova:project>
Aug 15 21:56:34 user nova-compute[72992]:       </nova:owner>
Aug 15 21:56:34 user nova-compute[72992]:       <nova:ports>
Aug 15 21:56:34 user nova-compute[72992]:         <nova:port uuid="5496d042-c208-4bca-bb09-cabbbdce9258">
Aug 15 21:56:34 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 21:56:34 user nova-compute[72992]:         </nova:port>
Aug 15 21:56:34 user nova-compute[72992]:       </nova:ports>
Aug 15 21:56:34 user nova-compute[72992]:     </nova:instance>
Aug 15 21:56:34 user nova-compute[72992]:   </metadata>
Aug 15 21:56:34 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:56:34 user nova-compute[72992]:     <system>
Aug 15 21:56:34 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:56:34 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:56:34 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:56:34 user nova-compute[72992]:       <entry name="serial">cb284ace-6c4c-45d8-a746-c43bbf06f7d3</entry>
Aug 15 21:56:34 user nova-compute[72992]:       <entry name="uuid">cb284ace-6c4c-45d8-a746-c43bbf06f7d3</entry>
Aug 15 21:56:34 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:56:34 user nova-compute[72992]:     </system>
Aug 15 21:56:34 user nova-compute[72992]:   </sysinfo>
Aug 15 21:56:34 user nova-compute[72992]:   <os>
Aug 15 21:56:34 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:56:34 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:56:34 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:56:34 user nova-compute[72992]:   </os>
Aug 15 21:56:34 user nova-compute[72992]:   <features>
Aug 15 21:56:34 user nova-compute[72992]:     <acpi/>
Aug 15 21:56:34 user nova-compute[72992]:     <apic/>
Aug 15 21:56:34 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:56:34 user nova-compute[72992]:   </features>
Aug 15 21:56:34 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:56:34 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:56:34 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:56:34 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:56:34 user nova-compute[72992]:   </clock>
Aug 15 21:56:34 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:56:34 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:56:34 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:56:34 user nova-compute[72992]:   </cpu>
Aug 15 21:56:34 user nova-compute[72992]:   <devices>
Aug 15 21:56:34 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:56:34 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:56:34 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:56:34 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:56:34 user nova-compute[72992]:       <serial>39bd3132-85e0-4a1a-8b37-2e348bb81169</serial>
Aug 15 21:56:34 user nova-compute[72992]:     </disk>
Aug 15 21:56:34 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:56:34 user nova-compute[72992]:       <mac address="fa:16:3e:64:7e:c5"/>
Aug 15 21:56:34 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:56:34 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:56:34 user nova-compute[72992]:       <target dev="tap5496d042-c2"/>
Aug 15 21:56:34 user nova-compute[72992]:     </interface>
Aug 15 21:56:34 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:56:34 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/cb284ace-6c4c-45d8-a746-c43bbf06f7d3/console.log" append="off"/>
Aug 15 21:56:34 user nova-compute[72992]:     </serial>
Aug 15 21:56:34 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:56:34 user nova-compute[72992]:     <video>
Aug 15 21:56:34 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:56:34 user nova-compute[72992]:     </video>
Aug 15 21:56:34 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:56:34 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:56:34 user nova-compute[72992]:     </rng>
Aug 15 21:56:34 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:56:34 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:56:34 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:56:34 user nova-compute[72992]:     </memballoon>
Aug 15 21:56:34 user nova-compute[72992]:   </devices>
Aug 15 21:56:34 user nova-compute[72992]: </domain>
Aug 15 21:56:34 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1587495923',display_name='tempest-TestVolumeBootPattern-server-1587495923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1587495923',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-cok980ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:56:24Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=cb284ace-6c4c-45d8-a746-c43bbf06f7d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5496d042-c208-4bca-bb09-cabbbdce9258,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496d042-c2') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG os_vif [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5496d042-c208-4bca-bb09-cabbbdce9258,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496d042-c2') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5496d042-c2, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5496d042-c2, col_values=(('external_ids', {'iface-id': '5496d042-c208-4bca-bb09-cabbbdce9258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:7e:c5', 'vm-uuid': 'cb284ace-6c4c-45d8-a746-c43bbf06f7d3'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:34 user nova-compute[72992]: INFO os_vif [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5496d042-c208-4bca-bb09-cabbbdce9258,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496d042-c2')
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:56:34 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No VIF found with MAC fa:16:3e:64:7e:c5, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:56:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-2a7034fe-b24e-4e02-8403-564b0ebebad8 req-882edd5f-8ca8-4e3c-9152-253dc53758e9 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2a7034fe-b24e-4e02-8403-564b0ebebad8 req-882edd5f-8ca8-4e3c-9152-253dc53758e9 service nova] Acquiring lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2a7034fe-b24e-4e02-8403-564b0ebebad8 req-882edd5f-8ca8-4e3c-9152-253dc53758e9 service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-2a7034fe-b24e-4e02-8403-564b0ebebad8 req-882edd5f-8ca8-4e3c-9152-253dc53758e9 service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG nova.compute.manager [req-2a7034fe-b24e-4e02-8403-564b0ebebad8 req-882edd5f-8ca8-4e3c-9152-253dc53758e9 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] No waiting events found dispatching network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:56:36 user nova-compute[72992]: WARNING nova.compute.manager [req-2a7034fe-b24e-4e02-8403-564b0ebebad8 req-882edd5f-8ca8-4e3c-9152-253dc53758e9 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received unexpected event network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 for instance with vm_state building and task_state spawning.
Aug 15 21:56:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136598.0838807, cb284ace-6c4c-45d8-a746-c43bbf06f7d3 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:56:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] VM Resumed (Lifecycle Event)
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:56:38 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Instance spawned successfully.
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:56:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136598.0876536, cb284ace-6c4c-45d8-a746-c43bbf06f7d3 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:56:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] VM Started (Lifecycle Event)
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:56:38 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:56:38 user nova-compute[72992]: INFO nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:56:38 user nova-compute[72992]: INFO nova.compute.manager [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Took 14.41 seconds to build instance.
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-52c14ad6-1f8d-4b9c-a377-fe9021d59ca1 req-f788eb50-a58d-47da-9f42-6473c40fc30b service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-52c14ad6-1f8d-4b9c-a377-fe9021d59ca1 req-f788eb50-a58d-47da-9f42-6473c40fc30b service nova] Acquiring lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-52c14ad6-1f8d-4b9c-a377-fe9021d59ca1 req-f788eb50-a58d-47da-9f42-6473c40fc30b service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-52c14ad6-1f8d-4b9c-a377-fe9021d59ca1 req-f788eb50-a58d-47da-9f42-6473c40fc30b service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:56:38 user nova-compute[72992]: DEBUG nova.compute.manager [req-52c14ad6-1f8d-4b9c-a377-fe9021d59ca1 req-f788eb50-a58d-47da-9f42-6473c40fc30b service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] No waiting events found dispatching network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:56:38 user nova-compute[72992]: WARNING nova.compute.manager [req-52c14ad6-1f8d-4b9c-a377-fe9021d59ca1 req-f788eb50-a58d-47da-9f42-6473c40fc30b service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received unexpected event network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 for instance with vm_state active and task_state None.
Aug 15 21:56:38 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-3dc0b54b-09a0-4144-bafc-f48b2202b842 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.505s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:56:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:56:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:56:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:56:44 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:56:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:56:45 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:56:45 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:56:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=25.350231170654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance cb284ace-6c4c-45d8-a746-c43bbf06f7d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:56:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:56:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:56:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:56:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:56:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:56:47 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:56:47 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid cb284ace-6c4c-45d8-a746-c43bbf06f7d3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:56:48 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updating instance_info_cache with network_info: [{"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:56:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:56:48 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:56:48 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:49 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:56:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:56:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:56:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:56:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:57:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:57:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:57:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:57:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:57:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:57:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:57:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:57:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:57:44 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:57:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:57:45 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:57:45 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:57:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=25.349567413330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance cb284ace-6c4c-45d8-a746-c43bbf06f7d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:57:45 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:57:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:57:49 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid cb284ace-6c4c-45d8-a746-c43bbf06f7d3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:57:50 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updating instance_info_cache with network_info: [{"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:57:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:57:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:57:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:57:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:57:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:57:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:58:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG nova.compute.manager [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-changed-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG nova.compute.manager [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Refreshing instance network info cache due to event network-changed-5496d042-c208-4bca-bb09-cabbbdce9258. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] Acquiring lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] Acquired lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG nova.network.neutron [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Refreshing network info cache for port 5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:58:16 user nova-compute[72992]: INFO nova.compute.manager [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Terminating instance
Aug 15 21:58:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG nova.network.neutron [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updated VIF entry in instance network info cache for port 5496d042-c208-4bca-bb09-cabbbdce9258. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG nova.network.neutron [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updating instance_info_cache with network_info: [{"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-4b4f414a-f059-46e2-abd9-014e0a55c21e req-e45e3899-b287-4b0c-a6ac-d3180c93e6af service nova] Releasing lock "refresh_cache-cb284ace-6c4c-45d8-a746-c43bbf06f7d3" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:58:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-a0429d17-1dcb-41c7-ad95-1cf174be2e84 req-1348735c-86e5-446b-8f29-013c4aced5b8 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-vif-unplugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a0429d17-1dcb-41c7-ad95-1cf174be2e84 req-1348735c-86e5-446b-8f29-013c4aced5b8 service nova] Acquiring lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a0429d17-1dcb-41c7-ad95-1cf174be2e84 req-1348735c-86e5-446b-8f29-013c4aced5b8 service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a0429d17-1dcb-41c7-ad95-1cf174be2e84 req-1348735c-86e5-446b-8f29-013c4aced5b8 service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-a0429d17-1dcb-41c7-ad95-1cf174be2e84 req-1348735c-86e5-446b-8f29-013c4aced5b8 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] No waiting events found dispatching network-vif-unplugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.compute.manager [req-a0429d17-1dcb-41c7-ad95-1cf174be2e84 req-1348735c-86e5-446b-8f29-013c4aced5b8 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-vif-unplugged-5496d042-c208-4bca-bb09-cabbbdce9258 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 21:58:17 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Instance destroyed successfully.
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.objects.instance [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'resources' on Instance uuid cb284ace-6c4c-45d8-a746-c43bbf06f7d3 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1587495923',display_name='tempest-TestVolumeBootPattern-server-1587495923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1587495923',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-cok980ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:56:38Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=cb284ace-6c4c-45d8-a746-c43bbf06f7d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "5496d042-c208-4bca-bb09-cabbbdce9258", "address": "fa:16:3e:64:7e:c5", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496d042-c2", "ovs_interfaceid": "5496d042-c208-4bca-bb09-cabbbdce9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5496d042-c208-4bca-bb09-cabbbdce9258,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496d042-c2') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_vif [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5496d042-c208-4bca-bb09-cabbbdce9258,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496d042-c2') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5496d042-c2, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:58:17 user nova-compute[72992]: INFO os_vif [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5496d042-c208-4bca-bb09-cabbbdce9258,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496d042-c2')
Aug 15 21:58:17 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:58:17 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff5aaa-7da0-4f12-90db-e65db0485033]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2648bca8-46c5-4075-a550-a0e05154a12f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 21:58:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 21:58:17 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c84940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e82f1e-1fd8-4a54-bedd-1b28818831b4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22aa3b8-49fc-40ec-b4ae-2ca4c25fbd54]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec56ac4-aed7-4eaa-9697-6102b3538556]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15dcee-f751-4e59-befd-95486f011c46]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1238b951', '/dev/disk/by-id/scsi-23633333662643130', '/dev/disk/by-id/scsi-1SCST_BIO1238b951-6336bd10876e61af') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1ee8fb-208c-4ca6-a471-155216af3941]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 21:58:17 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f51818-2198-4d3c-8f3f-ead703391652]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1673bec5-549b-4743-bfd0-e9b9860681bd]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]
Aug 15 21:58:18 user nova-compute[72992]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.
Aug 15 21:58:18 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bf58d8-5683-453a-872b-1ec0ea6b8235]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== disconnect_volume: return (273ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 21:58:18 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Deleting instance files /opt/stack/data/nova/instances/cb284ace-6c4c-45d8-a746-c43bbf06f7d3_del
Aug 15 21:58:18 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Deletion of /opt/stack/data/nova/instances/cb284ace-6c4c-45d8-a746-c43bbf06f7d3_del complete
Aug 15 21:58:18 user nova-compute[72992]: INFO nova.compute.manager [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 15 21:58:18 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 21:58:18 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:58:18 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Took 0.72 seconds to deallocate network for instance.
Aug 15 21:58:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-c393e646-1ba3-46b4-ad4b-6d980084b268 req-8f5fb159-92d5-48b0-ac21-a3b0d182a318 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c393e646-1ba3-46b4-ad4b-6d980084b268 req-8f5fb159-92d5-48b0-ac21-a3b0d182a318 service nova] Acquiring lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c393e646-1ba3-46b4-ad4b-6d980084b268 req-8f5fb159-92d5-48b0-ac21-a3b0d182a318 service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c393e646-1ba3-46b4-ad4b-6d980084b268 req-8f5fb159-92d5-48b0-ac21-a3b0d182a318 service nova] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-c393e646-1ba3-46b4-ad4b-6d980084b268 req-8f5fb159-92d5-48b0-ac21-a3b0d182a318 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] No waiting events found dispatching network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:58:19 user nova-compute[72992]: WARNING nova.compute.manager [req-c393e646-1ba3-46b4-ad4b-6d980084b268 req-8f5fb159-92d5-48b0-ac21-a3b0d182a318 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received unexpected event network-vif-plugged-5496d042-c208-4bca-bb09-cabbbdce9258 for instance with vm_state active and task_state deleting.
Aug 15 21:58:19 user nova-compute[72992]: DEBUG nova.compute.manager [req-c393e646-1ba3-46b4-ad4b-6d980084b268 req-8f5fb159-92d5-48b0-ac21-a3b0d182a318 service nova] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Received event network-vif-deleted-5496d042-c208-4bca-bb09-cabbbdce9258 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:58:19 user nova-compute[72992]: INFO nova.compute.manager [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 21:58:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:58:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:58:19 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Deleted allocations for instance cb284ace-6c4c-45d8-a746-c43bbf06f7d3
Aug 15 21:58:19 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bc6bb2a3-eaf3-4331-91b4-d29afa0b3df7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "cb284ace-6c4c-45d8-a746-c43bbf06f7d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.977s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:58:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:32 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692136697.773459, cb284ace-6c4c-45d8-a746-c43bbf06f7d3 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:58:32 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] VM Stopped (Lifecycle Event)
Aug 15 21:58:32 user nova-compute[72992]: DEBUG nova.compute.manager [None req-3fda0548-b18a-47f3-a2a8-55e3beacb34a None None] [instance: cb284ace-6c4c-45d8-a746-c43bbf06f7d3] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:58:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:58:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:58:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:58:46 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:58:46 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:58:47 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:58:47 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:58:47 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.34865951538086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:58:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:58:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:58:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:58:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:58:50 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 21:58:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:58:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:59:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:59:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 21:59:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:59:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 21:59:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 21:59:08 user nova-compute[72992]: INFO nova.compute.claims [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Claim successful on node user
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.177s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 21:59:08 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 21:59:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 21:59:08 user nova-compute[72992]: INFO nova.virt.block_device [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Booting with volume 39bd3132-85e0-4a1a-8b37-2e348bb81169 at /dev/vda
Aug 15 21:59:09 user nova-compute[72992]: DEBUG nova.policy [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ac4abe94f1400c9ffc2dc1e7725253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb04a16dcfc4270a451facd41d87968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG os_brick.utils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1af2bc-09d5-44b7-bb90-093198f15402]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4812c58-abf2-4a38-9319-503c55e23513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9067a7c-4e70-4a58-b850-e9d3c167bc9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00f5a2-14b6-44c5-87a1-6c8ed7f24ab1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 21:59:09 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 21:59:09 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8bf1b7-f5a2-414b-b815-fe185435fdc3]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG os_brick.utils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating existing volume attachment record: f1e1ab6d-6a4a-4a46-ad7c-42ce4a596498 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 21:59:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Successfully created port: 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Successfully updated port: 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-changed-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Refreshing instance network info cache due to event network-changed-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Instance network_info: |[{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:59:10 user nova-compute[72992]: DEBUG nova.network.neutron [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Refreshing network info cache for port 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 21:59:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updated VIF entry in instance network info cache for port 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 21:59:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:59:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-a7389b43-c408-4fa1-aaa6-4c244547e4ce req-c7edd703-8de8-4751-963b-992d29bbc5fa service nova] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:59:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:59:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 21:59:23 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Creating image(s)
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Ensure instance console log exists: /opt/stack/data/nova/instances/34dc1467-2916-42a1-b317-ceda9e7eb401/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Start _get_guest_xml network_info=[{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34dc1467-2916-42a1-b317-ceda9e7eb401', 'attached_at': '', 'detached_at': '', 'volume_id': '39bd3132-85e0-4a1a-8b37-2e348bb81169', 'serial': '39bd3132-85e0-4a1a-8b37-2e348bb81169'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'f1e1ab6d-6a4a-4a46-ad7c-42ce4a596498', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 21:59:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:59:23 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 21:59:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:59:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 21:59:23 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fac598a-3522-419f-b470-66bec79a093a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 21:59:23 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[64001a38-60f3-4f80-b838-a17c880e6fab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169] added
Aug 15 21:59:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d0ef0-4697-47a2-a62f-01dc47519931]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb737aba-4166-46e0-bde9-6e77e4320d98]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQWKZDzA {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQWKZDzA" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94a4c62-e8c6-470a-b4a6-2bc814bf012d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQWKZDzA'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[019da52f-c5ec-4f7c-be4a-bd4f0ba2654d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6007261f-8c04-49ac-8383-107cab3aa8a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:59:23 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 21:59:23 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:59:23 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 21:59:23 user nova-compute[72992]: 
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fcf5c6-cd05-4fca-9ef1-58c56b68491b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]
Aug 15 21:59:23 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.
Aug 15 21:59:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[91577a91-c1da-4fe7-a185-6ae4a7d4fe1e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5afb7d-78af-49f5-83e2-78aa848c9660]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 21:59:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 21:59:24 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddba2e26-5153-419c-871f-c826824d24c3]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 21:59:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23633333662643130', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633333662643130', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1527428247',display_name='tempest-TestVolumeBootPattern-server-1527428247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1527428247',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-8ckc7dvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:59:09Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=34dc1467-2916-42a1-b317-ceda9e7eb401,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4c:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b0576d2-0f4a-4b8b-874b-bcdb19352e6e,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0576d2-0f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'pci_devices' on Instance uuid 34dc1467-2916-42a1-b317-ceda9e7eb401 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] End _get_guest_xml xml=<domain type="kvm">
Aug 15 21:59:25 user nova-compute[72992]:   <uuid>34dc1467-2916-42a1-b317-ceda9e7eb401</uuid>
Aug 15 21:59:25 user nova-compute[72992]:   <name>instance-00000033</name>
Aug 15 21:59:25 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 21:59:25 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 21:59:25 user nova-compute[72992]:   <metadata>
Aug 15 21:59:25 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 21:59:25 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 21:59:25 user nova-compute[72992]:       <nova:name>tempest-TestVolumeBootPattern-server-1527428247</nova:name>
Aug 15 21:59:25 user nova-compute[72992]:       <nova:creationTime>2023-08-15 21:59:23</nova:creationTime>
Aug 15 21:59:25 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 21:59:25 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 21:59:25 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 21:59:25 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 21:59:25 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 21:59:25 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 21:59:25 user nova-compute[72992]:       </nova:flavor>
Aug 15 21:59:25 user nova-compute[72992]:       <nova:owner>
Aug 15 21:59:25 user nova-compute[72992]:         <nova:user uuid="68ac4abe94f1400c9ffc2dc1e7725253">tempest-TestVolumeBootPattern-6524685-project-member</nova:user>
Aug 15 21:59:25 user nova-compute[72992]:         <nova:project uuid="1bb04a16dcfc4270a451facd41d87968">tempest-TestVolumeBootPattern-6524685</nova:project>
Aug 15 21:59:25 user nova-compute[72992]:       </nova:owner>
Aug 15 21:59:25 user nova-compute[72992]:       <nova:ports>
Aug 15 21:59:25 user nova-compute[72992]:         <nova:port uuid="8b0576d2-0f4a-4b8b-874b-bcdb19352e6e">
Aug 15 21:59:25 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 21:59:25 user nova-compute[72992]:         </nova:port>
Aug 15 21:59:25 user nova-compute[72992]:       </nova:ports>
Aug 15 21:59:25 user nova-compute[72992]:     </nova:instance>
Aug 15 21:59:25 user nova-compute[72992]:   </metadata>
Aug 15 21:59:25 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 21:59:25 user nova-compute[72992]:     <system>
Aug 15 21:59:25 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 21:59:25 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 21:59:25 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 21:59:25 user nova-compute[72992]:       <entry name="serial">34dc1467-2916-42a1-b317-ceda9e7eb401</entry>
Aug 15 21:59:25 user nova-compute[72992]:       <entry name="uuid">34dc1467-2916-42a1-b317-ceda9e7eb401</entry>
Aug 15 21:59:25 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 21:59:25 user nova-compute[72992]:     </system>
Aug 15 21:59:25 user nova-compute[72992]:   </sysinfo>
Aug 15 21:59:25 user nova-compute[72992]:   <os>
Aug 15 21:59:25 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 21:59:25 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 21:59:25 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 21:59:25 user nova-compute[72992]:   </os>
Aug 15 21:59:25 user nova-compute[72992]:   <features>
Aug 15 21:59:25 user nova-compute[72992]:     <acpi/>
Aug 15 21:59:25 user nova-compute[72992]:     <apic/>
Aug 15 21:59:25 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 21:59:25 user nova-compute[72992]:   </features>
Aug 15 21:59:25 user nova-compute[72992]:   <clock offset="utc">
Aug 15 21:59:25 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 21:59:25 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 21:59:25 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 21:59:25 user nova-compute[72992]:   </clock>
Aug 15 21:59:25 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 21:59:25 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 21:59:25 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 21:59:25 user nova-compute[72992]:   </cpu>
Aug 15 21:59:25 user nova-compute[72992]:   <devices>
Aug 15 21:59:25 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 21:59:25 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 21:59:25 user nova-compute[72992]:       <source dev="/dev/sdb"/>
Aug 15 21:59:25 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 21:59:25 user nova-compute[72992]:       <serial>39bd3132-85e0-4a1a-8b37-2e348bb81169</serial>
Aug 15 21:59:25 user nova-compute[72992]:     </disk>
Aug 15 21:59:25 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 21:59:25 user nova-compute[72992]:       <mac address="fa:16:3e:2a:4c:f8"/>
Aug 15 21:59:25 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:59:25 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 21:59:25 user nova-compute[72992]:       <target dev="tap8b0576d2-0f"/>
Aug 15 21:59:25 user nova-compute[72992]:     </interface>
Aug 15 21:59:25 user nova-compute[72992]:     <serial type="pty">
Aug 15 21:59:25 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/34dc1467-2916-42a1-b317-ceda9e7eb401/console.log" append="off"/>
Aug 15 21:59:25 user nova-compute[72992]:     </serial>
Aug 15 21:59:25 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 21:59:25 user nova-compute[72992]:     <video>
Aug 15 21:59:25 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 21:59:25 user nova-compute[72992]:     </video>
Aug 15 21:59:25 user nova-compute[72992]:     <rng model="virtio">
Aug 15 21:59:25 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 21:59:25 user nova-compute[72992]:     </rng>
Aug 15 21:59:25 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 21:59:25 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 21:59:25 user nova-compute[72992]:       <stats period="10"/>
Aug 15 21:59:25 user nova-compute[72992]:     </memballoon>
Aug 15 21:59:25 user nova-compute[72992]:   </devices>
Aug 15 21:59:25 user nova-compute[72992]: </domain>
Aug 15 21:59:25 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1527428247',display_name='tempest-TestVolumeBootPattern-server-1527428247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1527428247',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-8ckc7dvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T21:59:09Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=34dc1467-2916-42a1-b317-ceda9e7eb401,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4c:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b0576d2-0f4a-4b8b-874b-bcdb19352e6e,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0576d2-0f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG os_vif [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4c:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b0576d2-0f4a-4b8b-874b-bcdb19352e6e,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0576d2-0f') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b0576d2-0f, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b0576d2-0f, col_values=(('external_ids', {'iface-id': '8b0576d2-0f4a-4b8b-874b-bcdb19352e6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:4c:f8', 'vm-uuid': '34dc1467-2916-42a1-b317-ceda9e7eb401'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:25 user nova-compute[72992]: INFO os_vif [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:4c:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b0576d2-0f4a-4b8b-874b-bcdb19352e6e,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0576d2-0f')
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 21:59:25 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No VIF found with MAC fa:16:3e:2a:4c:f8, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-61641719-57e2-42d1-9301-d0bbcfa22464 req-63725480-2baf-47eb-9072-a48b66ad1e1a service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-61641719-57e2-42d1-9301-d0bbcfa22464 req-63725480-2baf-47eb-9072-a48b66ad1e1a service nova] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-61641719-57e2-42d1-9301-d0bbcfa22464 req-63725480-2baf-47eb-9072-a48b66ad1e1a service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-61641719-57e2-42d1-9301-d0bbcfa22464 req-63725480-2baf-47eb-9072-a48b66ad1e1a service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG nova.compute.manager [req-61641719-57e2-42d1-9301-d0bbcfa22464 req-63725480-2baf-47eb-9072-a48b66ad1e1a service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] No waiting events found dispatching network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:59:26 user nova-compute[72992]: WARNING nova.compute.manager [req-61641719-57e2-42d1-9301-d0bbcfa22464 req-63725480-2baf-47eb-9072-a48b66ad1e1a service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received unexpected event network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e for instance with vm_state building and task_state spawning.
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136768.5865502, 34dc1467-2916-42a1-b317-ceda9e7eb401 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:59:28 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] VM Resumed (Lifecycle Event)
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 21:59:28 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Instance spawned successfully.
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 21:59:28 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136768.5881267, 34dc1467-2916-42a1-b317-ceda9e7eb401 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 21:59:28 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] VM Started (Lifecycle Event)
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-646d9276-20a2-4e31-8974-e21515fab0ed req-f9cc850b-0126-4109-a65a-88e686988d55 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-646d9276-20a2-4e31-8974-e21515fab0ed req-f9cc850b-0126-4109-a65a-88e686988d55 service nova] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-646d9276-20a2-4e31-8974-e21515fab0ed req-f9cc850b-0126-4109-a65a-88e686988d55 service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-646d9276-20a2-4e31-8974-e21515fab0ed req-f9cc850b-0126-4109-a65a-88e686988d55 service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [req-646d9276-20a2-4e31-8974-e21515fab0ed req-f9cc850b-0126-4109-a65a-88e686988d55 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] No waiting events found dispatching network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 21:59:28 user nova-compute[72992]: WARNING nova.compute.manager [req-646d9276-20a2-4e31-8974-e21515fab0ed req-f9cc850b-0126-4109-a65a-88e686988d55 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received unexpected event network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e for instance with vm_state building and task_state spawning.
Aug 15 21:59:28 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 21:59:28 user nova-compute[72992]: INFO nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 15 21:59:28 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 21:59:28 user nova-compute[72992]: INFO nova.compute.manager [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Took 20.17 seconds to build instance.
Aug 15 21:59:28 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c92d7cc5-41d9-47e9-a4cc-1aa56224f172 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.255s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:59:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:32 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:48 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:59:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:59:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:59:48 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 21:59:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 21:59:49 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:59:49 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8801MB free_disk=25.347015380859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 34dc1467-2916-42a1-b317-ceda9e7eb401 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 21:59:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 21:59:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 21:59:52 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 34dc1467-2916-42a1-b317-ceda9e7eb401 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 21:59:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:53 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 21:59:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 21:59:53 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 21:59:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 21:59:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 22:00:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 22:00:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 22:00:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:00:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:00:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:33 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:35 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid 34dc1467-2916-42a1-b317-ceda9e7eb401 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 22:00:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:00:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:00:35 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:00:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:43 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:48 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:00:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:00:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:00:48 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:00:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 22:00:49 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:00:49 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:00:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.346389770507812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 34dc1467-2916-42a1-b317-ceda9e7eb401 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:00:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:00:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:00:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:00:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:00:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:00:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:00:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:00:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:00:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:00:54 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 34dc1467-2916-42a1-b317-ceda9e7eb401 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:00:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:00:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:00:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:00:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:00:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-changed-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:01:00 user nova-compute[72992]: DEBUG nova.compute.manager [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Refreshing instance network info cache due to event network-changed-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 22:01:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:01:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:01:00 user nova-compute[72992]: DEBUG nova.network.neutron [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Refreshing network info cache for port 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 22:01:01 user nova-compute[72992]: DEBUG nova.network.neutron [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updated VIF entry in instance network info cache for port 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 22:01:01 user nova-compute[72992]: DEBUG nova.network.neutron [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:01:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8bc574c3-02b0-46f5-9f74-c5c77f91bd35 req-5173eab6-980d-4674-bd42-2bf9dc7bd981 service nova] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:01:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "e0aaac39-83d5-4b45-904c-f7fda0256e19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 22:01:13 user nova-compute[72992]: INFO nova.compute.claims [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Claim successful on node user
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.network.neutron [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 22:01:13 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 22:01:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 22:01:14 user nova-compute[72992]: INFO nova.virt.block_device [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Booting with volume 3de81a37-aae0-40c5-9fc1-6f9aab57e90a at /dev/vda
Aug 15 22:01:14 user nova-compute[72992]: DEBUG nova.policy [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ac4abe94f1400c9ffc2dc1e7725253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bb04a16dcfc4270a451facd41d87968', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG os_brick.utils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f0d41-e309-4af3-952e-bb0e470c7bf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50646398-de95-4171-a1c8-54fd1a72d1d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71badd2-a5d0-4fbf-9a38-3f0c4748e908]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d588e0-8ff1-4242-85d9-75f23bc2ca8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:01:14 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 22:01:14 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1469027-a067-482d-8cc4-9e2d1956ebbe]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG os_brick.utils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updating existing volume attachment record: b9b9f0d2-843c-42ce-9057-3a596605deb2 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 22:01:14 user nova-compute[72992]: DEBUG nova.network.neutron [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Successfully created port: febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Successfully updated port: febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquired lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-changed-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.compute.manager [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Refreshing instance network info cache due to event network-changed-febf32a9-6ab0-446b-a5a3-be150e88063a. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] Acquiring lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.network.neutron [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updating instance_info_cache with network_info: [{"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Releasing lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Instance network_info: |[{"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] Acquired lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:01:15 user nova-compute[72992]: DEBUG nova.network.neutron [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Refreshing network info cache for port febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 22:01:16 user nova-compute[72992]: DEBUG nova.network.neutron [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updated VIF entry in instance network info cache for port febf32a9-6ab0-446b-a5a3-be150e88063a. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 22:01:16 user nova-compute[72992]: DEBUG nova.network.neutron [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updating instance_info_cache with network_info: [{"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:01:16 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-206eeb93-3209-4ebc-9d20-8f0595539a2e req-2175648b-6b57-4fb3-9e51-f99f2bd39727 service nova] Releasing lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:01:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 22:01:22 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Creating image(s)
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Did not create local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Ensure instance console log exists: /opt/stack/data/nova/instances/e0aaac39-83d5-4b45-904c-f7fda0256e19/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Start _get_guest_xml network_info=[{"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWmVEgXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e0aaac39-83d5-4b45-904c-f7fda0256e19', 'attached_at': '', 'detached_at': '', 'volume_id': '3de81a37-aae0-40c5-9fc1-6f9aab57e90a', 'serial': '3de81a37-aae0-40c5-9fc1-6f9aab57e90a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b9b9f0d2-843c-42ce-9057-3a596605deb2', 'volume_type': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 22:01:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:01:22 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWmVEgXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:01:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:01:22 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:01:22 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1cafec-7ba0-4d08-9d06-acb14a244bcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 22:01:22 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0d6ab3-e4c0-4201-a2a2-44345e3f2e6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a] added
Aug 15 22:01:22 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b227082-ec67-4888-9797-b76fbfdf49be]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033800b-12ba-4196-9ef4-99c81a1b7744]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:22 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWmVEgXF {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWmVEgXF" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc1b98f-df52-486b-8d3a-52a8876ad92b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWmVEgXF'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bea058c-f526-467a-9dc1-4882bf293bcf]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a721d364-7ccd-4496-84ac-21be288c1661]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:01:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:01:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54f1bb9-ba98-416b-9351-e1b000ab5953]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260]
Aug 15 22:01:23 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260] successful.
Aug 15 22:01:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[76500fdf-9103-4347-8572-02840f74b27a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b7750-9736-4cc6-a56a-58add4dcce75]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:01:23 user nova-compute[72992]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a (non-flash)
Aug 15 22:01:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:01:23 user nova-compute[72992]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a (non-flash)
Aug 15 22:01:23 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[576fa782-a8ba-4c4d-8da1-b94a3c091c15]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:01:23 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWmVEgXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23533656566383366', 'path': '/dev/sdc'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533656566383366', 'path': '/dev/sdc'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T22:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-484062428',display_name='tempest-TestVolumeBootPattern-server-484062428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-484062428',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-heshv868',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T22:01:14Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=e0aaac39-83d5-4b45-904c-f7fda0256e19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=febf32a9-6ab0-446b-a5a3-be150e88063a,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebf32a9-6a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'pci_devices' on Instance uuid e0aaac39-83d5-4b45-904c-f7fda0256e19 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] End _get_guest_xml xml=<domain type="kvm">
Aug 15 22:01:24 user nova-compute[72992]:   <uuid>e0aaac39-83d5-4b45-904c-f7fda0256e19</uuid>
Aug 15 22:01:24 user nova-compute[72992]:   <name>instance-00000034</name>
Aug 15 22:01:24 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 22:01:24 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 22:01:24 user nova-compute[72992]:   <metadata>
Aug 15 22:01:24 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 22:01:24 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 22:01:24 user nova-compute[72992]:       <nova:name>tempest-TestVolumeBootPattern-server-484062428</nova:name>
Aug 15 22:01:24 user nova-compute[72992]:       <nova:creationTime>2023-08-15 22:01:22</nova:creationTime>
Aug 15 22:01:24 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 22:01:24 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 22:01:24 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 22:01:24 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 22:01:24 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 22:01:24 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 22:01:24 user nova-compute[72992]:       </nova:flavor>
Aug 15 22:01:24 user nova-compute[72992]:       <nova:owner>
Aug 15 22:01:24 user nova-compute[72992]:         <nova:user uuid="68ac4abe94f1400c9ffc2dc1e7725253">tempest-TestVolumeBootPattern-6524685-project-member</nova:user>
Aug 15 22:01:24 user nova-compute[72992]:         <nova:project uuid="1bb04a16dcfc4270a451facd41d87968">tempest-TestVolumeBootPattern-6524685</nova:project>
Aug 15 22:01:24 user nova-compute[72992]:       </nova:owner>
Aug 15 22:01:24 user nova-compute[72992]:       <nova:ports>
Aug 15 22:01:24 user nova-compute[72992]:         <nova:port uuid="febf32a9-6ab0-446b-a5a3-be150e88063a">
Aug 15 22:01:24 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 22:01:24 user nova-compute[72992]:         </nova:port>
Aug 15 22:01:24 user nova-compute[72992]:       </nova:ports>
Aug 15 22:01:24 user nova-compute[72992]:     </nova:instance>
Aug 15 22:01:24 user nova-compute[72992]:   </metadata>
Aug 15 22:01:24 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 22:01:24 user nova-compute[72992]:     <system>
Aug 15 22:01:24 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 22:01:24 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 22:01:24 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 22:01:24 user nova-compute[72992]:       <entry name="serial">e0aaac39-83d5-4b45-904c-f7fda0256e19</entry>
Aug 15 22:01:24 user nova-compute[72992]:       <entry name="uuid">e0aaac39-83d5-4b45-904c-f7fda0256e19</entry>
Aug 15 22:01:24 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 22:01:24 user nova-compute[72992]:     </system>
Aug 15 22:01:24 user nova-compute[72992]:   </sysinfo>
Aug 15 22:01:24 user nova-compute[72992]:   <os>
Aug 15 22:01:24 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 22:01:24 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 22:01:24 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 22:01:24 user nova-compute[72992]:   </os>
Aug 15 22:01:24 user nova-compute[72992]:   <features>
Aug 15 22:01:24 user nova-compute[72992]:     <acpi/>
Aug 15 22:01:24 user nova-compute[72992]:     <apic/>
Aug 15 22:01:24 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 22:01:24 user nova-compute[72992]:   </features>
Aug 15 22:01:24 user nova-compute[72992]:   <clock offset="utc">
Aug 15 22:01:24 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 22:01:24 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 22:01:24 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 22:01:24 user nova-compute[72992]:   </clock>
Aug 15 22:01:24 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 22:01:24 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 22:01:24 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 22:01:24 user nova-compute[72992]:   </cpu>
Aug 15 22:01:24 user nova-compute[72992]:   <devices>
Aug 15 22:01:24 user nova-compute[72992]:     <disk type="block" device="disk">
Aug 15 22:01:24 user nova-compute[72992]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:01:24 user nova-compute[72992]:       <source dev="/dev/sdc"/>
Aug 15 22:01:24 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 22:01:24 user nova-compute[72992]:       <serial>3de81a37-aae0-40c5-9fc1-6f9aab57e90a</serial>
Aug 15 22:01:24 user nova-compute[72992]:     </disk>
Aug 15 22:01:24 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 22:01:24 user nova-compute[72992]:       <mac address="fa:16:3e:74:85:0c"/>
Aug 15 22:01:24 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 22:01:24 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 22:01:24 user nova-compute[72992]:       <target dev="tapfebf32a9-6a"/>
Aug 15 22:01:24 user nova-compute[72992]:     </interface>
Aug 15 22:01:24 user nova-compute[72992]:     <serial type="pty">
Aug 15 22:01:24 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e0aaac39-83d5-4b45-904c-f7fda0256e19/console.log" append="off"/>
Aug 15 22:01:24 user nova-compute[72992]:     </serial>
Aug 15 22:01:24 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 22:01:24 user nova-compute[72992]:     <video>
Aug 15 22:01:24 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 22:01:24 user nova-compute[72992]:     </video>
Aug 15 22:01:24 user nova-compute[72992]:     <rng model="virtio">
Aug 15 22:01:24 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 22:01:24 user nova-compute[72992]:     </rng>
Aug 15 22:01:24 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 22:01:24 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 22:01:24 user nova-compute[72992]:       <stats period="10"/>
Aug 15 22:01:24 user nova-compute[72992]:     </memballoon>
Aug 15 22:01:24 user nova-compute[72992]:   </devices>
Aug 15 22:01:24 user nova-compute[72992]: </domain>
Aug 15 22:01:24 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T22:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-484062428',display_name='tempest-TestVolumeBootPattern-server-484062428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-484062428',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-heshv868',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T22:01:14Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=e0aaac39-83d5-4b45-904c-f7fda0256e19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=febf32a9-6ab0-446b-a5a3-be150e88063a,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebf32a9-6a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG os_vif [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=febf32a9-6ab0-446b-a5a3-be150e88063a,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebf32a9-6a') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfebf32a9-6a, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfebf32a9-6a, col_values=(('external_ids', {'iface-id': 'febf32a9-6ab0-446b-a5a3-be150e88063a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:85:0c', 'vm-uuid': 'e0aaac39-83d5-4b45-904c-f7fda0256e19'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:24 user nova-compute[72992]: INFO os_vif [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=febf32a9-6ab0-446b-a5a3-be150e88063a,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebf32a9-6a')
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:01:24 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] No VIF found with MAC fa:16:3e:74:85:0c, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-3f9ecd39-9859-4742-b33f-d2e01725ef90 req-a35528c0-0951-45f8-bec5-89b02708c353 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3f9ecd39-9859-4742-b33f-d2e01725ef90 req-a35528c0-0951-45f8-bec5-89b02708c353 service nova] Acquiring lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3f9ecd39-9859-4742-b33f-d2e01725ef90 req-a35528c0-0951-45f8-bec5-89b02708c353 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3f9ecd39-9859-4742-b33f-d2e01725ef90 req-a35528c0-0951-45f8-bec5-89b02708c353 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG nova.compute.manager [req-3f9ecd39-9859-4742-b33f-d2e01725ef90 req-a35528c0-0951-45f8-bec5-89b02708c353 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] No waiting events found dispatching network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:01:25 user nova-compute[72992]: WARNING nova.compute.manager [req-3f9ecd39-9859-4742-b33f-d2e01725ef90 req-a35528c0-0951-45f8-bec5-89b02708c353 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received unexpected event network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a for instance with vm_state building and task_state spawning.
Aug 15 22:01:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136887.6269314, e0aaac39-83d5-4b45-904c-f7fda0256e19 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 22:01:27 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] VM Resumed (Lifecycle Event)
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 22:01:27 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Instance spawned successfully.
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:01:27 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692136887.630749, e0aaac39-83d5-4b45-904c-f7fda0256e19 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 22:01:27 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] VM Started (Lifecycle Event)
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 22:01:27 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 22:01:27 user nova-compute[72992]: INFO nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:01:27 user nova-compute[72992]: INFO nova.compute.manager [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Took 14.23 seconds to build instance.
Aug 15 22:01:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6ee848a7-b560-440e-94d6-c54caaf58d0d tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.337s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-58d99979-99b1-4519-b6f1-faf6a5ce37c1 req-3dceb652-d19b-4388-ba68-6bdf54ed2405 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-58d99979-99b1-4519-b6f1-faf6a5ce37c1 req-3dceb652-d19b-4388-ba68-6bdf54ed2405 service nova] Acquiring lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-58d99979-99b1-4519-b6f1-faf6a5ce37c1 req-3dceb652-d19b-4388-ba68-6bdf54ed2405 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-58d99979-99b1-4519-b6f1-faf6a5ce37c1 req-3dceb652-d19b-4388-ba68-6bdf54ed2405 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:01:27 user nova-compute[72992]: DEBUG nova.compute.manager [req-58d99979-99b1-4519-b6f1-faf6a5ce37c1 req-3dceb652-d19b-4388-ba68-6bdf54ed2405 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] No waiting events found dispatching network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:01:27 user nova-compute[72992]: WARNING nova.compute.manager [req-58d99979-99b1-4519-b6f1-faf6a5ce37c1 req-3dceb652-d19b-4388-ba68-6bdf54ed2405 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received unexpected event network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a for instance with vm_state active and task_state None.
Aug 15 22:01:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:35 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:01:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:01:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:01:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:01:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:01:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 22:01:49 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 22:01:50 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:01:50 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8685MB free_disk=25.344505310058594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 34dc1467-2916-42a1-b317-ceda9e7eb401 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0aaac39-83d5-4b45-904c-f7fda0256e19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:01:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:01:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:52 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:01:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:01:54 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 34dc1467-2916-42a1-b317-ceda9e7eb401 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:01:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:01:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:01:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:01:55 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:01:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:01:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:02:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:02:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:19 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:02:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:24 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:02:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:02:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:34 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:36 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:02:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:39 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:48 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:49 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:02:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:02:50 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:02:50 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:02:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 22:02:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 22:02:51 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:02:51 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.343875885009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 34dc1467-2916-42a1-b317-ceda9e7eb401 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e0aaac39-83d5-4b45-904c-f7fda0256e19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:02:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:02:55 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:02:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:02:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:02:55 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:02:56 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updating instance_info_cache with network_info: [{"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:02:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:02:56 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:02:56 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:02:59 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:03:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-changed-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:03:05 user nova-compute[72992]: DEBUG nova.compute.manager [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Refreshing instance network info cache due to event network-changed-febf32a9-6ab0-446b-a5a3-be150e88063a. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 22:03:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] Acquiring lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:03:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] Acquired lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:03:05 user nova-compute[72992]: DEBUG nova.network.neutron [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Refreshing network info cache for port febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG nova.network.neutron [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updated VIF entry in instance network info cache for port febf32a9-6ab0-446b-a5a3-be150e88063a. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG nova.network.neutron [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updating instance_info_cache with network_info: [{"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-06d65520-0aa4-4a4e-adb3-6a074fb284fa req-7ff77b67-027d-4832-95e9-ca34ec1a2973 service nova] Releasing lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-changed-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Refreshing instance network info cache due to event network-changed-febf32a9-6ab0-446b-a5a3-be150e88063a. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] Acquiring lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] Acquired lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG nova.network.neutron [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Refreshing network info cache for port febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "e0aaac39-83d5-4b45-904c-f7fda0256e19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:03:06 user nova-compute[72992]: INFO nova.compute.manager [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Terminating instance
Aug 15 22:03:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:06 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.network.neutron [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updated VIF entry in instance network info cache for port febf32a9-6ab0-446b-a5a3-be150e88063a. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.network.neutron [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updating instance_info_cache with network_info: [{"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-df880f50-c58c-4dda-9222-d58d588bfb0d req-4bcb975d-174b-40a9-844e-a30b94d5edc2 service nova] Releasing lock "refresh_cache-e0aaac39-83d5-4b45-904c-f7fda0256e19" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:03:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Instance destroyed successfully.
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'resources' on Instance uuid e0aaac39-83d5-4b45-904c-f7fda0256e19 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T22:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-484062428',display_name='tempest-TestVolumeBootPattern-server-484062428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-484062428',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=<?>,launch_index=0,launched_at=2023-08-15T22:01:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-heshv868',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T22:01:28Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=e0aaac39-83d5-4b45-904c-f7fda0256e19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "febf32a9-6ab0-446b-a5a3-be150e88063a", "address": "fa:16:3e:74:85:0c", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebf32a9-6a", "ovs_interfaceid": "febf32a9-6ab0-446b-a5a3-be150e88063a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=febf32a9-6ab0-446b-a5a3-be150e88063a,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebf32a9-6a') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_vif [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=febf32a9-6ab0-446b-a5a3-be150e88063a,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebf32a9-6a') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfebf32a9-6a, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:03:07 user nova-compute[72992]: INFO os_vif [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=febf32a9-6ab0-446b-a5a3-be150e88063a,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebf32a9-6a')
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWmVEgXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:03:07 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ecc303-3756-43c8-ba1d-ad8457d00f85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d323177-28b3-496f-8817-992aef993218]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:03:07 user nova-compute[72992]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a (non-flash)
Aug 15 22:03:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:03:07 user nova-compute[72992]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a (non-flash)
Aug 15 22:03:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0cb7b58280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a'): ({'sdc'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Removing single pathed devices sdc {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c4e75b-63ff-4a45-b420-dccf364c38ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ffa2a4-6687-48cb-98a8-3fea4657f212]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flushing IO for device /dev/sdc {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[37599a1b-c1f4-4ae9-bda7-f056fc9a12b5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfca8736-955e-4064-bc8d-310c6eacce9f]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] SCSI volumes sdc have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf3560efe-53eef83f275ebb5d', '/dev/disk/by-id/scsi-23533656566383366', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f3560efe') {{(pid=84389) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 22:03:07 user nova-compute[72992]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf3560efe-53eef83f275ebb5d
Aug 15 22:03:07 user nova-compute[72992]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23533656566383366
Aug 15 22:03:07 user nova-compute[72992]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f3560efe
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ebd34f-5d61-493c-aa23-b3560e44aee8]: (4, None) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba9847-6fa4-4fd7-8f1e-9845c2e5ab36]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-vif-unplugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] Acquiring lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] No waiting events found dispatching network-vif-unplugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-vif-unplugged-febf32a9-6ab0-446b-a5a3-be150e88063a for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] Acquiring lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.compute.manager [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] No waiting events found dispatching network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:03:07 user nova-compute[72992]: WARNING nova.compute.manager [req-c5869aff-b1cd-4503-89f5-6fed70180af4 req-76f8392a-5ef0-4e59-8798-c40ef8931185 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received unexpected event network-vif-plugged-febf32a9-6ab0-446b-a5a3-be150e88063a for instance with vm_state active and task_state deleting.
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded6e3e-3bb0-4107-81de-f246f65da927]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260]
Aug 15 22:03:07 user nova-compute[72992]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a, portal: 172.16.0.220,3260] successful.
Aug 15 22:03:07 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de81a37-aae0-40c5-9fc1-6f9aab57e90a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89e9e48-fc0c-4138-8fee-d00914482c36]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== disconnect_volume: return (295ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 22:03:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Deleting instance files /opt/stack/data/nova/instances/e0aaac39-83d5-4b45-904c-f7fda0256e19_del
Aug 15 22:03:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Deletion of /opt/stack/data/nova/instances/e0aaac39-83d5-4b45-904c-f7fda0256e19_del complete
Aug 15 22:03:07 user nova-compute[72992]: INFO nova.compute.manager [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 15 22:03:07 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 22:03:07 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 22:03:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:08 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:03:08 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Took 0.55 seconds to deallocate network for instance.
Aug 15 22:03:09 user nova-compute[72992]: INFO nova.compute.manager [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 22:03:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:03:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:03:09 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:03:09 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:03:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:03:09 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Deleted allocations for instance e0aaac39-83d5-4b45-904c-f7fda0256e19
Aug 15 22:03:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-26eacac2-7b2a-4555-9600-1a9a6f90bf77 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "e0aaac39-83d5-4b45-904c-f7fda0256e19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.740s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:03:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-ed9c2354-c22c-4a99-9c8a-2975ec36b813 req-ebbc03ef-474c-43ca-b7f7-c7903fbd0f96 service nova] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Received event network-vif-deleted-febf32a9-6ab0-446b-a5a3-be150e88063a {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:03:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:03:22 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692136987.529394, e0aaac39-83d5-4b45-904c-f7fda0256e19 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 22:03:22 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] VM Stopped (Lifecycle Event)
Aug 15 22:03:22 user nova-compute[72992]: DEBUG nova.compute.manager [None req-0f2b7848-fc66-4b1b-bd1f-d5cff8a4e0f7 None None] [instance: e0aaac39-83d5-4b45-904c-f7fda0256e19] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:03:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:03:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:03:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:37 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:03:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:03:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:03:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:03:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:03:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72992) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 22:03:52 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:03:52 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:03:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=25.342975616455078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance 34dc1467-2916-42a1-b317-ceda9e7eb401 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:03:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:03:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:03:57 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid 34dc1467-2916-42a1-b317-ceda9e7eb401 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:03:58 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:03:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:03:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:03:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:04:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-changed-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG nova.compute.manager [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Refreshing instance network info cache due to event network-changed-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] Acquiring lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] Acquired lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG nova.network.neutron [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Refreshing network info cache for port 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:04:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:04:09 user nova-compute[72992]: INFO nova.compute.manager [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Terminating instance
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-be8fc9bd-0440-40d8-9956-f58350036c92 req-e9110a49-db69-4d35-b9b0-71bdd6750b22 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-vif-unplugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-be8fc9bd-0440-40d8-9956-f58350036c92 req-e9110a49-db69-4d35-b9b0-71bdd6750b22 service nova] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-be8fc9bd-0440-40d8-9956-f58350036c92 req-e9110a49-db69-4d35-b9b0-71bdd6750b22 service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-be8fc9bd-0440-40d8-9956-f58350036c92 req-e9110a49-db69-4d35-b9b0-71bdd6750b22 service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-be8fc9bd-0440-40d8-9956-f58350036c92 req-e9110a49-db69-4d35-b9b0-71bdd6750b22 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] No waiting events found dispatching network-vif-unplugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.compute.manager [req-be8fc9bd-0440-40d8-9956-f58350036c92 req-e9110a49-db69-4d35-b9b0-71bdd6750b22 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-vif-unplugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 22:04:10 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Instance destroyed successfully.
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.objects.instance [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lazy-loading 'resources' on Instance uuid 34dc1467-2916-42a1-b317-ceda9e7eb401 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T21:59:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1527428247',display_name='tempest-TestVolumeBootPattern-server-1527428247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1527428247',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Pgi7SU3ZvCeotpulELklWK59zPqKEM3A/hBhsoM2Tp9voC1iGTWq1aso0JpAq+Fpe3oJBWj2JN2+zAVqK49gse2XFwtG+ViaA1P77QjZ6fNVZmPmq97Qrk7ljhojzXw==',key_name='tempest-TestVolumeBootPattern-30882365',keypairs=<?>,launch_index=0,launched_at=2023-08-15T21:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bb04a16dcfc4270a451facd41d87968',ramdisk_id='',reservation_id='r-8ckc7dvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-6524685',owner_user_name='tempest-TestVolumeBootPattern-6524685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T21:59:29Z,user_data=None,user_id='68ac4abe94f1400c9ffc2dc1e7725253',uuid=34dc1467-2916-42a1-b317-ceda9e7eb401,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converting VIF {"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4c:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b0576d2-0f4a-4b8b-874b-bcdb19352e6e,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0576d2-0f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_vif [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4c:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b0576d2-0f4a-4b8b-874b-bcdb19352e6e,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0576d2-0f') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b0576d2-0f, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:04:10 user nova-compute[72992]: INFO os_vif [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:4c:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b0576d2-0f4a-4b8b-874b-bcdb19352e6e,network=Network(758a58a2-6d8c-4222-8a1a-958730e1d122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b0576d2-0f')
Aug 15 22:04:10 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQWKZDzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:04:10 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f7b3da-b79e-4235-a9a3-be0ad270ba5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb7b35-da7c-4331-a44e-a4d2715d0bd9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:04:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 (non-flash)
Aug 15 22:04:10 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64eb0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e881cd-2159-4d37-b37b-6a43c6680541]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c3ff2c-cf0a-44fb-ba15-3000f948096c]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[92670494-75eb-499a-8120-232422c3f985]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 22:04:10 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba4505-93d7-408f-bccf-b487852e383b]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updated VIF entry in instance network info cache for port 8b0576d2-0f4a-4b8b-874b-bcdb19352e6e. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG nova.network.neutron [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [{"id": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "address": "fa:16:3e:2a:4c:f8", "network": {"id": "758a58a2-6d8c-4222-8a1a-958730e1d122", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-302120752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bb04a16dcfc4270a451facd41d87968", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b0576d2-0f", "ovs_interfaceid": "8b0576d2-0f4a-4b8b-874b-bcdb19352e6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf9f8be-a9fb-4c99-ad1f-34c42adfcae9]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-50192655-fdb1-4d0a-892f-f825ac4a8532 req-e471b3f5-a210-4bdb-be38-507857134b23 service nova] Releasing lock "refresh_cache-34dc1467-2916-42a1-b317-ceda9e7eb401" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f30b0-1842-4e62-b94b-4d654d8ca532]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260]
Aug 15 22:04:11 user nova-compute[72992]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169, portal: 172.16.0.220,3260] successful.
Aug 15 22:04:11 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39bd3132-85e0-4a1a-8b37-2e348bb81169 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e560d2a-bd4a-4aca-aa25-8c064478e7cc]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] <== disconnect_volume: return (329ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 22:04:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Deleting instance files /opt/stack/data/nova/instances/34dc1467-2916-42a1-b317-ceda9e7eb401_del
Aug 15 22:04:11 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Deletion of /opt/stack/data/nova/instances/34dc1467-2916-42a1-b317-ceda9e7eb401_del complete
Aug 15 22:04:11 user nova-compute[72992]: INFO nova.compute.manager [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 15 22:04:11 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 22:04:11 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:04:11 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Took 0.58 seconds to deallocate network for instance.
Aug 15 22:04:12 user nova-compute[72992]: INFO nova.compute.manager [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Took 0.73 seconds to detach 1 volumes for instance.
Aug 15 22:04:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-11909a9b-2906-41e2-b6ed-2ae88e5b205e req-24b3ccbd-b780-4fe0-ba7e-0bbf73cc052b service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-11909a9b-2906-41e2-b6ed-2ae88e5b205e req-24b3ccbd-b780-4fe0-ba7e-0bbf73cc052b service nova] Acquiring lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-11909a9b-2906-41e2-b6ed-2ae88e5b205e req-24b3ccbd-b780-4fe0-ba7e-0bbf73cc052b service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-11909a9b-2906-41e2-b6ed-2ae88e5b205e req-24b3ccbd-b780-4fe0-ba7e-0bbf73cc052b service nova] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-11909a9b-2906-41e2-b6ed-2ae88e5b205e req-24b3ccbd-b780-4fe0-ba7e-0bbf73cc052b service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] No waiting events found dispatching network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:04:12 user nova-compute[72992]: WARNING nova.compute.manager [req-11909a9b-2906-41e2-b6ed-2ae88e5b205e req-24b3ccbd-b780-4fe0-ba7e-0bbf73cc052b service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received unexpected event network-vif-plugged-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e for instance with vm_state active and task_state deleting.
Aug 15 22:04:12 user nova-compute[72992]: DEBUG nova.compute.manager [req-11909a9b-2906-41e2-b6ed-2ae88e5b205e req-24b3ccbd-b780-4fe0-ba7e-0bbf73cc052b service nova] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Received event network-vif-deleted-8b0576d2-0f4a-4b8b-874b-bcdb19352e6e {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:04:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:04:12 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Deleted allocations for instance 34dc1467-2916-42a1-b317-ceda9e7eb401
Aug 15 22:04:12 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-102e47ef-4d89-4330-8799-b29208cdc3f7 tempest-TestVolumeBootPattern-6524685 tempest-TestVolumeBootPattern-6524685-project-member] Lock "34dc1467-2916-42a1-b317-ceda9e7eb401" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:04:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:25 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692137050.7740977, 34dc1467-2916-42a1-b317-ceda9e7eb401 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 22:04:25 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] VM Stopped (Lifecycle Event)
Aug 15 22:04:25 user nova-compute[72992]: DEBUG nova.compute.manager [None req-865f45a1-a877-49fa-973c-0b0ac6609548 None None] [instance: 34dc1467-2916-42a1-b317-ceda9e7eb401] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:04:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:04:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:04:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:04:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:04:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:38 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:40 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:48 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:04:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:04:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:04:51 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:04:52 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:04:52 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.334293365478516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:04:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:04:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:54 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:04:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:04:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:04:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:04:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:04:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:04:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:04:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:04:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:04:58 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 22:04:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:05:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:05:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:05:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:05:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:10 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:13 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:13 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 22:05:14 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:14 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 22:05:14 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 22:05:15 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:20 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:05:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:05:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:05:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:05:25 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:30 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:35 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:40 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:40 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:05:45 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:05:47 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:49 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:50 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:05:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:05:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:05:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:05:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:05:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:05:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:05:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.332271575927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:05:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:05:55 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:55 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:55 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:05:55 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:05:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:05:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:05:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:05:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 22:06:00 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:06:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:06:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:06:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:06:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:06:11 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:16 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:06:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:06:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:06:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:06:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:06:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:36 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:39 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:41 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:44 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:46 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:49 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:51 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:06:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:06:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:06:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:06:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:06:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:06:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=25.32778549194336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:06:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:06:54 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:56 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:57 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:06:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:06:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:06:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:06:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:06:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 22:06:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:06:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Starting instance... {{(pid=72992) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72992) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 22:07:00 user nova-compute[72992]: INFO nova.compute.claims [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Claim successful on node user
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Start building networks asynchronously for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Allocating IP information in the background. {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.network.neutron [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] allocate_for_instance() {{(pid=72992) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 22:07:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Start building block device mappings for instance. {{(pid=72992) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.policy [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fef94d74251447c2b224394d475afe26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '819b1afc05ea4b36a24f7aac67fe423c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72992) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Start spawning the instance on the hypervisor. {{(pid=72992) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Creating instance directory {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 22:07:00 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Creating image(s)
Aug 15 22:07:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "/opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "/opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.219s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.196s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk 1073741824 {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d,backing_fmt=raw /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk 1073741824" returned: 0 in 0.092s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "0d1fc423a213fc4789ca293b958cbd4c92269e6d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1fc423a213fc4789ca293b958cbd4c92269e6d --force-share --output=json" returned: 0 in 0.208s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk. size=1073741824 {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Successfully created port: ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG nova.virt.disk.api [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Cannot resize image /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk to a smaller size. {{(pid=72992) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'migration_context' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Created local disks {{(pid=72992) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Ensure instance console log exists: /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/console.log {{(pid=72992) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Successfully updated port: ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Building network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Instance cache missing network info. {{(pid=72992) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-changed-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG nova.compute.manager [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Refreshing instance network info cache due to event network-changed-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 22:07:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.neutron [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Instance network_info: |[{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72992) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Refreshing network info cache for port ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Start _get_guest_xml network_info=[{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'image_id': 'ca16bfd3-6680-457d-af6e-aad43cd3fadd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 22:07:03 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:07:03 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CPU controller missing on host. {{(pid=72992) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.host [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CPU controller found on host. {{(pid=72992) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72992) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T21:09:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T21:09:26Z,direct_url=<?>,disk_format='qcow2',id=ca16bfd3-6680-457d-af6e-aad43cd3fadd,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7104e0de04484c12bdc6cdf1f7e22630',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T21:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Flavor limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Image limits 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Flavor pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Image pref 0:0:0 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72992) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Got 1 possible topologies {{(pid=72992) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.hardware [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72992) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T22:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-10622922',display_name='tempest-SnapshotDataIntegrityTests-server-10622922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-10622922',id=53,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXN1pboWe5YA2onfGWAcln6ZRd/oyEqB8gvtI9HeHjbPbpKBqM4K3vWKTKktygSSHdyABqDc9kiekbAti5nHSHPfi2Ikxr/194P9TbMizZlJ+PZaZ1UV5dC9AkB3wYNw==',key_name='tempest-keypair-1027229161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819b1afc05ea4b36a24f7aac67fe423c',ramdisk_id='',reservation_id='r-crn2zo28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-686268318',owner_user_name='tempest-SnapshotDataIntegrityTests-686268318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T22:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fef94d74251447c2b224394d475afe26',uuid=e5f9a32b-7cac-4b7b-92c0-69de7ee14923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72992) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Converting VIF {"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:a5:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba82fe6a-6ff0-4712-a6fc-f2e649a109a1,network=Network(182a100b-dc00-49ac-9b67-2b82e7a363cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba82fe6a-6f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.objects.instance [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'pci_devices' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] End _get_guest_xml xml=<domain type="kvm">
Aug 15 22:07:03 user nova-compute[72992]:   <uuid>e5f9a32b-7cac-4b7b-92c0-69de7ee14923</uuid>
Aug 15 22:07:03 user nova-compute[72992]:   <name>instance-00000035</name>
Aug 15 22:07:03 user nova-compute[72992]:   <memory>524288</memory>
Aug 15 22:07:03 user nova-compute[72992]:   <vcpu>1</vcpu>
Aug 15 22:07:03 user nova-compute[72992]:   <metadata>
Aug 15 22:07:03 user nova-compute[72992]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 22:07:03 user nova-compute[72992]:       <nova:package version="0.0.0"/>
Aug 15 22:07:03 user nova-compute[72992]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-10622922</nova:name>
Aug 15 22:07:03 user nova-compute[72992]:       <nova:creationTime>2023-08-15 22:07:03</nova:creationTime>
Aug 15 22:07:03 user nova-compute[72992]:       <nova:flavor name="m1.tiny">
Aug 15 22:07:03 user nova-compute[72992]:         <nova:memory>512</nova:memory>
Aug 15 22:07:03 user nova-compute[72992]:         <nova:disk>1</nova:disk>
Aug 15 22:07:03 user nova-compute[72992]:         <nova:swap>0</nova:swap>
Aug 15 22:07:03 user nova-compute[72992]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 22:07:03 user nova-compute[72992]:         <nova:vcpus>1</nova:vcpus>
Aug 15 22:07:03 user nova-compute[72992]:       </nova:flavor>
Aug 15 22:07:03 user nova-compute[72992]:       <nova:owner>
Aug 15 22:07:03 user nova-compute[72992]:         <nova:user uuid="fef94d74251447c2b224394d475afe26">tempest-SnapshotDataIntegrityTests-686268318-project-member</nova:user>
Aug 15 22:07:03 user nova-compute[72992]:         <nova:project uuid="819b1afc05ea4b36a24f7aac67fe423c">tempest-SnapshotDataIntegrityTests-686268318</nova:project>
Aug 15 22:07:03 user nova-compute[72992]:       </nova:owner>
Aug 15 22:07:03 user nova-compute[72992]:       <nova:root type="image" uuid="ca16bfd3-6680-457d-af6e-aad43cd3fadd"/>
Aug 15 22:07:03 user nova-compute[72992]:       <nova:ports>
Aug 15 22:07:03 user nova-compute[72992]:         <nova:port uuid="ba82fe6a-6ff0-4712-a6fc-f2e649a109a1">
Aug 15 22:07:03 user nova-compute[72992]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 22:07:03 user nova-compute[72992]:         </nova:port>
Aug 15 22:07:03 user nova-compute[72992]:       </nova:ports>
Aug 15 22:07:03 user nova-compute[72992]:     </nova:instance>
Aug 15 22:07:03 user nova-compute[72992]:   </metadata>
Aug 15 22:07:03 user nova-compute[72992]:   <sysinfo type="smbios">
Aug 15 22:07:03 user nova-compute[72992]:     <system>
Aug 15 22:07:03 user nova-compute[72992]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 22:07:03 user nova-compute[72992]:       <entry name="product">OpenStack Nova</entry>
Aug 15 22:07:03 user nova-compute[72992]:       <entry name="version">0.0.0</entry>
Aug 15 22:07:03 user nova-compute[72992]:       <entry name="serial">e5f9a32b-7cac-4b7b-92c0-69de7ee14923</entry>
Aug 15 22:07:03 user nova-compute[72992]:       <entry name="uuid">e5f9a32b-7cac-4b7b-92c0-69de7ee14923</entry>
Aug 15 22:07:03 user nova-compute[72992]:       <entry name="family">Virtual Machine</entry>
Aug 15 22:07:03 user nova-compute[72992]:     </system>
Aug 15 22:07:03 user nova-compute[72992]:   </sysinfo>
Aug 15 22:07:03 user nova-compute[72992]:   <os>
Aug 15 22:07:03 user nova-compute[72992]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 22:07:03 user nova-compute[72992]:     <boot dev="hd"/>
Aug 15 22:07:03 user nova-compute[72992]:     <smbios mode="sysinfo"/>
Aug 15 22:07:03 user nova-compute[72992]:   </os>
Aug 15 22:07:03 user nova-compute[72992]:   <features>
Aug 15 22:07:03 user nova-compute[72992]:     <acpi/>
Aug 15 22:07:03 user nova-compute[72992]:     <apic/>
Aug 15 22:07:03 user nova-compute[72992]:     <vmcoreinfo/>
Aug 15 22:07:03 user nova-compute[72992]:   </features>
Aug 15 22:07:03 user nova-compute[72992]:   <clock offset="utc">
Aug 15 22:07:03 user nova-compute[72992]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 22:07:03 user nova-compute[72992]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 22:07:03 user nova-compute[72992]:     <timer name="hpet" present="no"/>
Aug 15 22:07:03 user nova-compute[72992]:   </clock>
Aug 15 22:07:03 user nova-compute[72992]:   <cpu mode="custom" match="exact">
Aug 15 22:07:03 user nova-compute[72992]:     <model>Nehalem</model>
Aug 15 22:07:03 user nova-compute[72992]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 22:07:03 user nova-compute[72992]:   </cpu>
Aug 15 22:07:03 user nova-compute[72992]:   <devices>
Aug 15 22:07:03 user nova-compute[72992]:     <disk type="file" device="disk">
Aug 15 22:07:03 user nova-compute[72992]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 22:07:03 user nova-compute[72992]:       <source file="/opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk"/>
Aug 15 22:07:03 user nova-compute[72992]:       <target dev="vda" bus="virtio"/>
Aug 15 22:07:03 user nova-compute[72992]:     </disk>
Aug 15 22:07:03 user nova-compute[72992]:     <interface type="ethernet">
Aug 15 22:07:03 user nova-compute[72992]:       <mac address="fa:16:3e:44:a5:dd"/>
Aug 15 22:07:03 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 22:07:03 user nova-compute[72992]:       <mtu size="1442"/>
Aug 15 22:07:03 user nova-compute[72992]:       <target dev="tapba82fe6a-6f"/>
Aug 15 22:07:03 user nova-compute[72992]:     </interface>
Aug 15 22:07:03 user nova-compute[72992]:     <serial type="pty">
Aug 15 22:07:03 user nova-compute[72992]:       <log file="/opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/console.log" append="off"/>
Aug 15 22:07:03 user nova-compute[72992]:     </serial>
Aug 15 22:07:03 user nova-compute[72992]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 22:07:03 user nova-compute[72992]:     <video>
Aug 15 22:07:03 user nova-compute[72992]:       <model type="virtio"/>
Aug 15 22:07:03 user nova-compute[72992]:     </video>
Aug 15 22:07:03 user nova-compute[72992]:     <rng model="virtio">
Aug 15 22:07:03 user nova-compute[72992]:       <backend model="random">/dev/urandom</backend>
Aug 15 22:07:03 user nova-compute[72992]:     </rng>
Aug 15 22:07:03 user nova-compute[72992]:     <controller type="usb" index="0" model="none"/>
Aug 15 22:07:03 user nova-compute[72992]:     <memballoon model="virtio">
Aug 15 22:07:03 user nova-compute[72992]:       <stats period="10"/>
Aug 15 22:07:03 user nova-compute[72992]:     </memballoon>
Aug 15 22:07:03 user nova-compute[72992]:   </devices>
Aug 15 22:07:03 user nova-compute[72992]: </domain>
Aug 15 22:07:03 user nova-compute[72992]:  {{(pid=72992) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T22:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-10622922',display_name='tempest-SnapshotDataIntegrityTests-server-10622922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-10622922',id=53,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXN1pboWe5YA2onfGWAcln6ZRd/oyEqB8gvtI9HeHjbPbpKBqM4K3vWKTKktygSSHdyABqDc9kiekbAti5nHSHPfi2Ikxr/194P9TbMizZlJ+PZaZ1UV5dC9AkB3wYNw==',key_name='tempest-keypair-1027229161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='819b1afc05ea4b36a24f7aac67fe423c',ramdisk_id='',reservation_id='r-crn2zo28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-686268318',owner_user_name='tempest-SnapshotDataIntegrityTests-686268318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T22:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fef94d74251447c2b224394d475afe26',uuid=e5f9a32b-7cac-4b7b-92c0-69de7ee14923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Converting VIF {"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:a5:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba82fe6a-6ff0-4712-a6fc-f2e649a109a1,network=Network(182a100b-dc00-49ac-9b67-2b82e7a363cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba82fe6a-6f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG os_vif [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:a5:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba82fe6a-6ff0-4712-a6fc-f2e649a109a1,network=Network(182a100b-dc00-49ac-9b67-2b82e7a363cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba82fe6a-6f') {{(pid=72992) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba82fe6a-6f, may_exist=True, interface_attrs={}) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba82fe6a-6f, col_values=(('external_ids', {'iface-id': 'ba82fe6a-6ff0-4712-a6fc-f2e649a109a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:a5:dd', 'vm-uuid': 'e5f9a32b-7cac-4b7b-92c0-69de7ee14923'}),), if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:03 user nova-compute[72992]: INFO os_vif [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:a5:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba82fe6a-6ff0-4712-a6fc-f2e649a109a1,network=Network(182a100b-dc00-49ac-9b67-2b82e7a363cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba82fe6a-6f')
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No VIF found with MAC fa:16:3e:44:a5:dd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated VIF entry in instance network info cache for port ba82fe6a-6ff0-4712-a6fc-f2e649a109a1. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG nova.network.neutron [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:07:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-c0f3b82a-8e1b-43c6-9a34-95f12d58da5a req-c9f7d085-4f03-40a0-af0d-fc95d2026a9c service nova] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-678a6e45-3277-49ce-954d-e8f97f52b71b req-cb9f1f69-f71f-4f9c-bbce-54be6071a40f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-678a6e45-3277-49ce-954d-e8f97f52b71b req-cb9f1f69-f71f-4f9c-bbce-54be6071a40f service nova] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-678a6e45-3277-49ce-954d-e8f97f52b71b req-cb9f1f69-f71f-4f9c-bbce-54be6071a40f service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-678a6e45-3277-49ce-954d-e8f97f52b71b req-cb9f1f69-f71f-4f9c-bbce-54be6071a40f service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:04 user nova-compute[72992]: DEBUG nova.compute.manager [req-678a6e45-3277-49ce-954d-e8f97f52b71b req-cb9f1f69-f71f-4f9c-bbce-54be6071a40f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] No waiting events found dispatching network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:07:04 user nova-compute[72992]: WARNING nova.compute.manager [req-678a6e45-3277-49ce-954d-e8f97f52b71b req-cb9f1f69-f71f-4f9c-bbce-54be6071a40f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received unexpected event network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 for instance with vm_state building and task_state spawning.
Aug 15 22:07:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:05 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ad1b168-b5fc-4e1e-8cae-27a7e24660c9 req-d6a83521-dcd9-48df-8fbc-4c3ca2ec17dc service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:07:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ad1b168-b5fc-4e1e-8cae-27a7e24660c9 req-d6a83521-dcd9-48df-8fbc-4c3ca2ec17dc service nova] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ad1b168-b5fc-4e1e-8cae-27a7e24660c9 req-d6a83521-dcd9-48df-8fbc-4c3ca2ec17dc service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-9ad1b168-b5fc-4e1e-8cae-27a7e24660c9 req-d6a83521-dcd9-48df-8fbc-4c3ca2ec17dc service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:06 user nova-compute[72992]: DEBUG nova.compute.manager [req-9ad1b168-b5fc-4e1e-8cae-27a7e24660c9 req-d6a83521-dcd9-48df-8fbc-4c3ca2ec17dc service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] No waiting events found dispatching network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:07:06 user nova-compute[72992]: WARNING nova.compute.manager [req-9ad1b168-b5fc-4e1e-8cae-27a7e24660c9 req-d6a83521-dcd9-48df-8fbc-4c3ca2ec17dc service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received unexpected event network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 for instance with vm_state building and task_state spawning.
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692137227.457757, e5f9a32b-7cac-4b7b-92c0-69de7ee14923 => Resumed> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 22:07:07 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] VM Resumed (Lifecycle Event)
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Instance event wait completed in 0 seconds for  {{(pid=72992) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Guest created on hypervisor {{(pid=72992) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 22:07:07 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Instance spawned successfully.
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Found default for hw_cdrom_bus of ide {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Found default for hw_disk_bus of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Found default for hw_input_bus of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Found default for hw_pointer_model of None {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Found default for hw_video_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Found default for hw_vif_model of virtio {{(pid=72992) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 22:07:07 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.virt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Emitting event <LifecycleEvent: 1692137227.4621933, e5f9a32b-7cac-4b7b-92c0-69de7ee14923 => Started> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 22:07:07 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] VM Started (Lifecycle Event)
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72992) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 22:07:07 user nova-compute[72992]: INFO nova.compute.manager [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 22:07:07 user nova-compute[72992]: INFO nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 15 22:07:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:07:07 user nova-compute[72992]: INFO nova.compute.manager [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Took 7.70 seconds to build instance.
Aug 15 22:07:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-a0a9d003-dec3-4f5d-a0d6-cdc30c6a6330 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.835s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:21 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:41 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:07:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:07:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:07:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:07:50 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:07:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:07:52 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:07:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:07:53 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:07:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=25.28656005859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:07:53 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:07:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:07:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:07:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:07:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:08:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:08:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:08:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:08:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:08:01 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:08:01 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:08:02 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:08:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:08:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:08:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:08:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:08:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:08:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:08:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:08:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:08:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:08:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:08:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:08:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:08:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:08:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:08:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:08:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-changed-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG nova.compute.manager [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Refreshing instance network info cache due to event network-changed-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1. {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Refreshing network info cache for port ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated VIF entry in instance network info cache for port ba82fe6a-6ff0-4712-a6fc-f2e649a109a1. {{(pid=72992) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG nova.network.neutron [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:08:51 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-3612d451-8fd6-4c29-9dfc-95df4d2e78ef req-2a588772-b1f8-46e5-8fd4-1544306c2b8f service nova] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:08:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:52 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:08:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:08:55 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:08:55 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.28478240966797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:08:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:08:56 user nova-compute[72992]: INFO nova.compute.manager [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attaching volume 40d7a889-2a6e-4522-a98a-41bfba868df6 to /dev/vdb
Aug 15 22:08:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c169e03-11ae-4bcd-8e8e-709fe445b232]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[945490e7-37e1-42e6-ae6c-a7f033616804]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f4b61-5e64-471d-9621-277bc16e8df1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[84272eda-bd33-4c51-9584-3b48e13ebcde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:08:56 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 22:08:56 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bb8ab0-7837-4339-be7b-b7c9031e81af]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG os_brick.utils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:08:56 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating existing volume attachment record: fafefdc5-52ec-4cd8-81fc-b0c1ece2ab95 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 22:08:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:08:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:08:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:09:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:09:03 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIeorYBO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:09:04 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:09:04 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:09:04 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c35fa9-36c4-4da0-a2be-acc4a63dfd2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 22:09:04 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb7159-1ab3-43e3-bf9e-139a499b5606]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6] added
Aug 15 22:09:04 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cb7470-f6c7-4ff6-bf17-b554c43b1337]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[51359792-83af-46d0-9c6f-9cd5c845589d]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIeorYBO {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIeorYBO" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7954598-c01f-47b5-8bda-8f13a4fe6e28]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gIeorYBO'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce28b5f-25f9-4789-975e-1036c80aad32]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1b16b0-7035-4e34-9bb9-340752179421]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:09:04 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:09:04 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:09:04 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:09:04 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 22:09:04 user nova-compute[72992]: 
Aug 15 22:09:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e575df64-3112-4bc3-9e74-f06ceac3858f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260]
Aug 15 22:09:05 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260] successful.
Aug 15 22:09:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[229448f7-f88e-4155-a4da-95716d89b0e4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbae72f-2c68-4454-9922-bbfa8b2dd293]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 (non-flash)
Aug 15 22:09:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 (non-flash)
Aug 15 22:09:05 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc72a5-95bd-4bf7-ac7c-eb5db455ec5c]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:09:05 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIeorYBO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26135623563333364', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135623563333364', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 22:09:06 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:09:06 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:09:06 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:09:06 user nova-compute[72992]:   <serial>40d7a889-2a6e-4522-a98a-41bfba868df6</serial>
Aug 15 22:09:06 user nova-compute[72992]: </disk>
Aug 15 22:09:06 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No VIF found with MAC fa:16:3e:44:a5:dd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 22:09:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-e6b092c0-31ef-48bd-a80f-b76a13f52083 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.576s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:09:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:09:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:09:32 user nova-compute[72992]: INFO nova.compute.manager [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Detaching volume 40d7a889-2a6e-4522-a98a-41bfba868df6
Aug 15 22:09:32 user nova-compute[72992]: INFO nova.virt.block_device [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attempting to driver detach volume 40d7a889-2a6e-4522-a98a-41bfba868df6 from mountpoint /dev/vdb
Aug 15 22:09:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Attempting to detach device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 22:09:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:09:32 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:09:32 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:09:32 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:09:32 user nova-compute[72992]:   <serial>40d7a889-2a6e-4522-a98a-41bfba868df6</serial>
Aug 15 22:09:32 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:09:32 user nova-compute[72992]: </disk>
Aug 15 22:09:32 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:09:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config.
Aug 15 22:09:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 22:09:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:09:32 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:09:32 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:09:32 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:09:32 user nova-compute[72992]:   <serial>40d7a889-2a6e-4522-a98a-41bfba868df6</serial>
Aug 15 22:09:32 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:09:32 user nova-compute[72992]: </disk>
Aug 15 22:09:32 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692137373.31902, e5f9a32b-7cac-4b7b-92c0-69de7ee14923 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 22:09:33 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config.
Aug 15 22:09:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIeorYBO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:09:33 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[163972db-2bd2-43de-a0b3-18aba35dcdaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e58c5-064c-48e5-bdc5-533df648edcd]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 (non-flash)
Aug 15 22:09:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 (non-flash)
Aug 15 22:09:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64e74f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e821e903-9ba5-4119-8a70-028ace8edff9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19d707d-4880-4c1f-9bf2-fb441aa6f0d7]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed56d198-569d-40b4-85e5-8d8452b0e27b]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b2c7e5-ccbc-4e3f-a78f-8227955ff8a2]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[87daf892-c105-4b4a-b0f1-e16f6025929a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4a84a7-367a-4555-b463-98a8906ffb4b]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260]
Aug 15 22:09:33 user nova-compute[72992]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6, portal: 172.16.0.220,3260] successful.
Aug 15 22:09:33 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40d7a889-2a6e-4522-a98a-41bfba868df6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b47b74-2dc8-443d-a911-40ace93e06f7]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== disconnect_volume: return (265ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:09:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:34 user nova-compute[72992]: DEBUG nova.objects.instance [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:09:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-6aac02fd-eebd-4ad4-a749-d44e6330b1ef tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:09:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:09:42 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:09:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:09:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:09:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:09:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:09:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:09:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:09:54 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:56 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:09:57 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:09:57 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=25.28350067138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:09:57 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:09:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:00 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:10:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:10:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:10:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:10:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:10:04 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:10:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:10:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:10:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:10:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:10:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:10:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:10:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:10:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:12 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 22:10:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 22:10:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:19 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:10:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:10:26 user nova-compute[72992]: DEBUG nova.objects.instance [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:10:26 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:10:27 user nova-compute[72992]: INFO nova.compute.manager [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attaching volume 510e5c64-0233-474c-b23f-52df27bdacc0 to /dev/vdb
Aug 15 22:10:27 user nova-compute[72992]: DEBUG os_brick.utils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919d6d1-9210-4fca-b285-0ac747ec05ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a2db65-94cd-4ac7-becc-d518603757dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3b5b7-cf7e-485c-b25b-99790560e306]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefca12a-3c44-4d6c-b389-f1f871df813f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:10:27 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a6d4aa-68ae-49ad-813a-17f55188bcdc]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG os_brick.utils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating existing volume attachment record: 74b1860c-79db-4625-ad62-efcdf62a3a43 {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:27 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 22:10:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:10:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:10:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:10:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BiYHNyCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:10:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:10:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:10:35 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[08353ca8-fe16-4d4f-a21a-78e6273f2712]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 22:10:35 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a587e66-2fa1-4c89-93d8-09860f765ad8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0] added
Aug 15 22:10:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d54dd26-db18-4fd2-8506-263074ea5f85]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[590a5c20-8650-4d31-86a9-1a0695d65c71]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BiYHNyCp {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BiYHNyCp" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38158a5-fc35-47a8-84a4-840070ec44d6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BiYHNyCp'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e5b6ab-899b-47c7-a2a6-2d97d250c85e]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a58ce29-8528-4d44-ac8e-9198a861cef6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:10:35 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:10:35 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:10:35 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 22:10:35 user nova-compute[72992]: 
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7780e663-ffe5-4886-bef0-84b46ddbaf61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260]
Aug 15 22:10:35 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260] successful.
Aug 15 22:10:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[405f992b-4abc-48f3-ae7e-6bc47e50b93a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08aec0e-19a5-4f0c-9e67-56ef94b7a8b6]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 (non-flash)
Aug 15 22:10:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 (non-flash)
Aug 15 22:10:35 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[224f371d-a5cc-4db7-9716-b0499eb78149]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:10:35 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BiYHNyCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 22:10:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:10:36 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26132346639306133', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:10:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132346639306133', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 22:10:36 user nova-compute[72992]: DEBUG nova.objects.instance [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:10:36 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 22:10:36 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:10:36 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:10:36 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:10:36 user nova-compute[72992]:   <serial>510e5c64-0233-474c-b23f-52df27bdacc0</serial>
Aug 15 22:10:36 user nova-compute[72992]: </disk>
Aug 15 22:10:36 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 22:10:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:10:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:10:37 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No VIF found with MAC fa:16:3e:44:a5:dd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 22:10:37 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-bb3dc804-252b-4af9-9da1-ee823ff5636e tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.299s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:10:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:10:39 user nova-compute[72992]: INFO nova.compute.manager [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Detaching volume 510e5c64-0233-474c-b23f-52df27bdacc0
Aug 15 22:10:39 user nova-compute[72992]: INFO nova.virt.block_device [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attempting to driver detach volume 510e5c64-0233-474c-b23f-52df27bdacc0 from mountpoint /dev/vdb
Aug 15 22:10:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Attempting to detach device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:10:39 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:10:39 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:10:39 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:10:39 user nova-compute[72992]:   <serial>510e5c64-0233-474c-b23f-52df27bdacc0</serial>
Aug 15 22:10:39 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:10:39 user nova-compute[72992]: </disk>
Aug 15 22:10:39 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:10:39 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config.
Aug 15 22:10:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:10:39 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:10:39 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:10:39 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:10:39 user nova-compute[72992]:   <serial>510e5c64-0233-474c-b23f-52df27bdacc0</serial>
Aug 15 22:10:39 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:10:39 user nova-compute[72992]: </disk>
Aug 15 22:10:39 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692137439.919053, e5f9a32b-7cac-4b7b-92c0-69de7ee14923 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 22:10:39 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config.
Aug 15 22:10:39 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BiYHNyCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:10:39 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf81916-52f9-4411-b29a-b9b0d664edca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a71e5-1c52-42a0-ad3e-1de7deba10ca]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 (non-flash)
Aug 15 22:10:39 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 (non-flash)
Aug 15 22:10:39 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c884a4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 22:10:39 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06a9e79-3446-4406-846b-9d385ca1c32b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d18c3-bab0-4854-8c66-3ac29411ee2d]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf1688-d77c-4cfa-8b9b-c380f2e52230]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb31fcdd-9481-48a7-9b54-53d2919b07a4]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2eed36-f118-403d-a836-93d07a2479d5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7976a19-b446-4fe1-abdb-4ce493e94f15]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260]
Aug 15 22:10:40 user nova-compute[72992]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0, portal: 172.16.0.220,3260] successful.
Aug 15 22:10:40 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510e5c64-0233-474c-b23f-52df27bdacc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a2f4bd-6217-41eb-9b3b-53c7e895e705]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== disconnect_volume: return (293ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG nova.objects.instance [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:10:40 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-fa090f7e-d42b-425c-ac93-93fc5ec670cf tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.598s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:10:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:10:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:46 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:56 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:58 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:10:59 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:10:59 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.282489776611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Triggering sync for uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:10:59 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:11:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:11:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:11:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:11:04 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:11:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:11:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:11:04 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:11:04 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:11:05 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:11:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:11:05 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:11:05 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:11:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:11:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:11:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:11:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:11:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:11:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:11:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:11:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:11:33 user nova-compute[72992]: INFO nova.compute.manager [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attaching volume ca108bbc-9470-4cf5-a0ec-064fe711e427 to /dev/vdb
Aug 15 22:11:34 user nova-compute[72992]: DEBUG os_brick.utils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc44676e-5afb-4f98-9888-3fdcf9e89e70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bf3aa1-912b-4138-98a2-c91a89e564af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a8b4d-2040-4f4e-b3ab-41f84c0c45db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef2583e-5512-425f-a29c-f70d97b368d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:11:34 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 22:11:34 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[23634633-1ba4-4f8b-9c01-2a6833a1cce5]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG os_brick.utils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:11:34 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating existing volume attachment record: 739a30a1-8aa1-4e9d-97f4-035ebfdf4d7d {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 22:11:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsPrhZGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:11:42 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:11:42 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:11:42 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[568e7978-7c27-441f-9929-cd15b26b1e58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 22:11:42 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5876969b-0462-4a13-89d7-f8225f73efa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427] added
Aug 15 22:11:42 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c4446-8f6d-4612-88f6-6f39d353f6ef]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[74da76e3-a6c4-4aa4-8477-bb15f0c74dd8]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsPrhZGj {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsPrhZGj" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9106759-b388-4a90-86aa-6ea3125cdb8a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zsPrhZGj'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[38404869-0c00-4772-8ae7-455084dcbe20]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4f129e-262c-46c2-a702-bfea67498f7e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:11:42 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:11:42 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:11:42 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 22:11:42 user nova-compute[72992]: 
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d59a2f-9cd1-44b8-9e72-66297760ff2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260]
Aug 15 22:11:42 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260] successful.
Aug 15 22:11:42 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:42 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f405af7-676e-4e36-8c7b-02b3e0edbeff]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2541fd-2a12-40ef-8649-f5baf5af359d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 (non-flash)
Aug 15 22:11:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 (non-flash)
Aug 15 22:11:43 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6a003b-75f0-42cc-8804-4aae7fb3d3a9]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:11:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsPrhZGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26166313439386664', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166313439386664', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG nova.objects.instance [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 22:11:44 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:11:44 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:11:44 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:11:44 user nova-compute[72992]:   <serial>ca108bbc-9470-4cf5-a0ec-064fe711e427</serial>
Aug 15 22:11:44 user nova-compute[72992]: </disk>
Aug 15 22:11:44 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No VIF found with MAC fa:16:3e:44:a5:dd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-28817096-5559-4b92-b686-957ca23472e5 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.796s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:11:44 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:11:47 user nova-compute[72992]: INFO nova.compute.manager [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Detaching volume ca108bbc-9470-4cf5-a0ec-064fe711e427
Aug 15 22:11:47 user nova-compute[72992]: INFO nova.virt.block_device [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attempting to driver detach volume ca108bbc-9470-4cf5-a0ec-064fe711e427 from mountpoint /dev/vdb
Aug 15 22:11:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Attempting to detach device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:11:47 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:11:47 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:11:47 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:11:47 user nova-compute[72992]:   <serial>ca108bbc-9470-4cf5-a0ec-064fe711e427</serial>
Aug 15 22:11:47 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:11:47 user nova-compute[72992]: </disk>
Aug 15 22:11:47 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:11:47 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config.
Aug 15 22:11:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:11:47 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:11:47 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:11:47 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:11:47 user nova-compute[72992]:   <serial>ca108bbc-9470-4cf5-a0ec-064fe711e427</serial>
Aug 15 22:11:47 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:11:47 user nova-compute[72992]: </disk>
Aug 15 22:11:47 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692137507.8290393, e5f9a32b-7cac-4b7b-92c0-69de7ee14923 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 22:11:47 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config.
Aug 15 22:11:47 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsPrhZGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:11:47 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee037a3-7cfb-4342-9777-5f94a49a11c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f624b4d-224e-4d0d-977f-368a7ee3c487]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 (non-flash)
Aug 15 22:11:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 (non-flash)
Aug 15 22:11:47 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64c8f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce365f1-f807-45e1-8352-34d7aa9d5770]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f88a324-886d-4fa0-be9a-0cc8d82ece77]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb9bbe8-c13e-4fde-95e8-44474048dc4a]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e108f1-908c-4c6b-86a7-d5c9186c80a0]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 22:11:47 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac513df-044b-4328-b18c-8d77a04a87b4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e6d32-9cb3-483e-bf63-9d8df437a04e]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260]
Aug 15 22:11:48 user nova-compute[72992]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427, portal: 172.16.0.220,3260] successful.
Aug 15 22:11:48 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca108bbc-9470-4cf5-a0ec-064fe711e427 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[64428597-c785-466b-9768-940328e28db2]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== disconnect_volume: return (256ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG nova.objects.instance [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:11:48 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-dda9084b-75d3-4f25-bd38-c7032425dd16 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:11:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:11:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:11:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:11:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:00 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:01 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:12:01 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:12:01 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.28150177001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:12:01 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:12:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:12:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:05 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:12:06 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:12:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:12:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:12:06 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:12:06 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:12:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:12:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:12:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:12:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:12:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:12:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:12:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:12:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:12:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:12:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:12:41 user nova-compute[72992]: INFO nova.compute.manager [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attaching volume 057b2770-b56b-4ba6-98a4-accbde75fbb5 to /dev/vdb
Aug 15 22:12:41 user nova-compute[72992]: DEBUG os_brick.utils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[81498931-96ea-429c-b0bb-d694af9373d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19613829da5e\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca5ee3-37cc-4daa-a329-7a54854e7e92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[21099fca-513c-4f05-b213-c98fc393166c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c12f6a-f335-4147-8d40-f30b0335693f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Running cmd (subprocess): nvme version {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] 'nvme version' failed. Not Retrying. {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] nvme not present on system {{(pid=72992) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 22:12:41 user nova-compute[72992]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 22:12:41 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a9562-db96-49ac-865e-d4d5a092fdf7]: (4, '') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72992) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.lightos [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] LIGHTOS: no hostnqn found. {{(pid=72992) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG os_brick.utils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19613829da5e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:12:41 user nova-compute[72992]: DEBUG nova.virt.block_device [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating existing volume attachment record: b9a20383-3df7-44aa-b264-10e59e79fb2d {{(pid=72992) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 22:12:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:12:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:12:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:12:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:12:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:49 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Calling os-brick to attach iSCSI Volume {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TILRWMZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:12:50 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:12:50 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:12:50 user nova-compute[72992]: INFO os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bdfc33-5081-4b1c-b7a2-c334c0ce054f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 22:12:50 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dac215-8fae-47cd-b362-57a158dff887]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5] added\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5] added
Aug 15 22:12:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9086b9-4a5b-476b-b23c-c5675245aff6]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[59262b8a-5a24-4491-a8f6-a31c231fc847]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TILRWMZn {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TILRWMZn" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11dcfc9-dc2c-417a-8410-ded9f4b49f56]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TILRWMZn'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[0035c813-493f-4c6e-b500-dbd9d778575f]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffdb7dc-9282-4d4d-9788-bd8995d59b6f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:12:50 user nova-compute[72992]:  {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 22:12:50 user nova-compute[72992]:  {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:12:50 user nova-compute[72992]: WARNING os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 22:12:50 user nova-compute[72992]: 
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --login {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bfa2b7-5529-4b93-8276-4ad00f392977]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260]
Aug 15 22:12:50 user nova-compute[72992]: Login to [iface: default, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260] successful.
Aug 15 22:12:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a73c9b-9fab-41fb-974c-845bbc77bbd1]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e83f03-0da4-4760-b05f-67a45ef0be03]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 (non-flash)
Aug 15 22:12:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 (non-flash)
Aug 15 22:12:50 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to 172.16.0.220:3260 {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72992) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72992) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[79691b10-e531-4056-b42e-42b4d7d6fca9]: (4, ('- - 0', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:50 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72992) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TILRWMZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72992) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26537646537666439', 'path': '/dev/sdb'} {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537646537666439', 'path': '/dev/sdb'} {{(pid=72992) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 22:12:51 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:12:51 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:12:51 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:12:51 user nova-compute[72992]:   <serial>057b2770-b56b-4ba6-98a4-accbde75fbb5</serial>
Aug 15 22:12:51 user nova-compute[72992]: </disk>
Aug 15 22:12:51 user nova-compute[72992]:  {{(pid=72992) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vda, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72992) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 22:12:51 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] No VIF found with MAC fa:16:3e:44:a5:dd, not building metadata {{(pid=72992) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 22:12:52 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c51f313a-9513-4b6b-b577-19d87b90cf81 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.315s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:12:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:12:54 user nova-compute[72992]: INFO nova.compute.manager [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Detaching volume 057b2770-b56b-4ba6-98a4-accbde75fbb5
Aug 15 22:12:54 user nova-compute[72992]: INFO nova.virt.block_device [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Attempting to driver detach volume 057b2770-b56b-4ba6-98a4-accbde75fbb5 from mountpoint /dev/vdb
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Attempting to detach device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config. {{(pid=72992) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:12:54 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:12:54 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:12:54 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:12:54 user nova-compute[72992]:   <serial>057b2770-b56b-4ba6-98a4-accbde75fbb5</serial>
Aug 15 22:12:54 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:12:54 user nova-compute[72992]: </disk>
Aug 15 22:12:54 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:12:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the persistent domain config.
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config. {{(pid=72992) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.guest [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 22:12:54 user nova-compute[72992]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 22:12:54 user nova-compute[72992]:   <source dev="/dev/sdb"/>
Aug 15 22:12:54 user nova-compute[72992]:   <target dev="vdb" bus="virtio"/>
Aug 15 22:12:54 user nova-compute[72992]:   <serial>057b2770-b56b-4ba6-98a4-accbde75fbb5</serial>
Aug 15 22:12:54 user nova-compute[72992]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 22:12:54 user nova-compute[72992]: </disk>
Aug 15 22:12:54 user nova-compute[72992]:  {{(pid=72992) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-8647ffab-078f-401b-926a-cd839b6beef1 None None] Received event <DeviceRemovedEvent: 1692137574.705642, e5f9a32b-7cac-4b7b-92c0-69de7ee14923 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72992) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.driver [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 22:12:54 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully detached device vdb from instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 from the live domain config.
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] calling os-brick to detach iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0c883883a0>, {'target_iqns': ['iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TILRWMZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 22:12:54 user nova-compute[72992]: WARNING os_brick.initiator.connectors.base [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5', 0)] {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c67b891-e626-43eb-89ab-60794462750e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e23f826-f3e3-4150-aa97-bc41013bb93c]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 (non-flash)\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 (non-flash)
Aug 15 22:12:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 (non-flash)
Aug 15 22:12:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c64b7a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5'): ({'sdb'}, set())}) {{(pid=72992) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Removing single pathed devices sdb {{(pid=72992) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56d843-6f16-42f1-a848-3b23c7512736]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[763cbcd3-5923-4a6b-93e1-b26fb3c34314]: (4, ('ok\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Flushing IO for device /dev/sdb {{(pid=72992) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecca043-b53d-47e8-a5b3-76fecf707ff5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72992) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5329950-31eb-4499-bab4-e04a9cd1b74e]: (4, ('1', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.linuxscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] SCSI volumes sdb have been removed. {{(pid=72992) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5')] {{(pid=72992) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[be44da49-c93c-4644-946b-ba73b61b1ac5]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --logout {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6fdc90-b8f3-4433-9e8b-2d85f42d040f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260]
Aug 15 22:12:54 user nova-compute[72992]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5, portal: 172.16.0.220,3260] successful.
Aug 15 22:12:54 user nova-compute[72992]:  stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op delete {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:057b2770-b56b-4ba6-98a4-accbde75fbb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84389) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e7810-0684-414a-b270-d020d2e44aa4]: (4, ('', '')) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72992) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.base [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG os_brick.initiator.connectors.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] <== disconnect_volume: return (274ms) None {{(pid=72992) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 22:12:54 user nova-compute[72992]: DEBUG nova.virt.libvirt.volume.iscsi [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Disconnected iSCSI Volume {{(pid=72992) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 22:12:55 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:12:55 user nova-compute[72992]: DEBUG nova.objects.instance [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'flavor' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:12:55 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-facf3d28-bad9-482e-bd8e-121f1992ae15 tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:12:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:12:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:01 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:01 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:13:02 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:13:03 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:13:03 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:13:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.280426025390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:13:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:05 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:06 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:07 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:13:07 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:13:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:13:07 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:13:07 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:13:07 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:13:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:13:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:13:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:13:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:33 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:38 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:43 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:48 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:13:51 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:53 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:57 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:13:58 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:13:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:02 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:02 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:14:03 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:14:04 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.processutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72992) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 22:14:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:14:05 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:14:05 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=25.279613494873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72992) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:14:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:14:07 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:08 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:08 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:14:09 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:14:09 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:14:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 22:14:09 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquired lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 22:14:09 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Forcefully refreshing network info cache for instance {{(pid=72992) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 22:14:09 user nova-compute[72992]: DEBUG nova.objects.instance [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lazy-loading 'info_cache' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:14:10 user nova-compute[72992]: DEBUG nova.network.neutron [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [{"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:14:10 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Releasing lock "refresh_cache-e5f9a32b-7cac-4b7b-92c0-69de7ee14923" {{(pid=72992) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 22:14:10 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updated the network info_cache for instance {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 22:14:13 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:13 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:14:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:14:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:18 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:23 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:14:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:14:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:14:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:28 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:14:31 user nova-compute[72992]: INFO nova.compute.manager [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Terminating instance
Aug 15 22:14:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Start destroying the instance on the hypervisor. {{(pid=72992) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:31 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-34d7a129-87ac-4ad4-8c4e-b69737dbe15c req-818ccd4d-4e9e-4a63-8ecd-def3dbd50991 service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-vif-unplugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-34d7a129-87ac-4ad4-8c4e-b69737dbe15c req-818ccd4d-4e9e-4a63-8ecd-def3dbd50991 service nova] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-34d7a129-87ac-4ad4-8c4e-b69737dbe15c req-818ccd4d-4e9e-4a63-8ecd-def3dbd50991 service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-34d7a129-87ac-4ad4-8c4e-b69737dbe15c req-818ccd4d-4e9e-4a63-8ecd-def3dbd50991 service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-34d7a129-87ac-4ad4-8c4e-b69737dbe15c req-818ccd4d-4e9e-4a63-8ecd-def3dbd50991 service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] No waiting events found dispatching network-vif-unplugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.compute.manager [req-34d7a129-87ac-4ad4-8c4e-b69737dbe15c req-818ccd4d-4e9e-4a63-8ecd-def3dbd50991 service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-vif-unplugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 for instance with task_state deleting. {{(pid=72992) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [-] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Instance destroyed successfully.
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.objects.instance [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lazy-loading 'resources' on Instance uuid e5f9a32b-7cac-4b7b-92c0-69de7ee14923 {{(pid=72992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.virt.libvirt.vif [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T22:06:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-10622922',display_name='tempest-SnapshotDataIntegrityTests-server-10622922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-10622922',id=53,image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkXN1pboWe5YA2onfGWAcln6ZRd/oyEqB8gvtI9HeHjbPbpKBqM4K3vWKTKktygSSHdyABqDc9kiekbAti5nHSHPfi2Ikxr/194P9TbMizZlJ+PZaZ1UV5dC9AkB3wYNw==',key_name='tempest-keypair-1027229161',keypairs=<?>,launch_index=0,launched_at=2023-08-15T22:07:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='819b1afc05ea4b36a24f7aac67fe423c',ramdisk_id='',reservation_id='r-crn2zo28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca16bfd3-6680-457d-af6e-aad43cd3fadd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-686268318',owner_user_name='tempest-SnapshotDataIntegrityTests-686268318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T22:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fef94d74251447c2b224394d475afe26',uuid=e5f9a32b-7cac-4b7b-92c0-69de7ee14923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Converting VIF {"id": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "address": "fa:16:3e:44:a5:dd", "network": {"id": "182a100b-dc00-49ac-9b67-2b82e7a363cc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1369034201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "819b1afc05ea4b36a24f7aac67fe423c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba82fe6a-6f", "ovs_interfaceid": "ba82fe6a-6ff0-4712-a6fc-f2e649a109a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.network.os_vif_util [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:a5:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba82fe6a-6ff0-4712-a6fc-f2e649a109a1,network=Network(182a100b-dc00-49ac-9b67-2b82e7a363cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba82fe6a-6f') {{(pid=72992) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG os_vif [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:a5:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba82fe6a-6ff0-4712-a6fc-f2e649a109a1,network=Network(182a100b-dc00-49ac-9b67-2b82e7a363cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba82fe6a-6f') {{(pid=72992) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba82fe6a-6f, bridge=br-int, if_exists=True) {{(pid=72992) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:14:32 user nova-compute[72992]: INFO os_vif [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:a5:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba82fe6a-6ff0-4712-a6fc-f2e649a109a1,network=Network(182a100b-dc00-49ac-9b67-2b82e7a363cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba82fe6a-6f')
Aug 15 22:14:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Deleting instance files /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923_del
Aug 15 22:14:32 user nova-compute[72992]: INFO nova.virt.libvirt.driver [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Deletion of /opt/stack/data/nova/instances/e5f9a32b-7cac-4b7b-92c0-69de7ee14923_del complete
Aug 15 22:14:32 user nova-compute[72992]: INFO nova.compute.manager [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 22:14:32 user nova-compute[72992]: DEBUG oslo.service.loopingcall [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72992) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.compute.manager [-] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Deallocating network for instance {{(pid=72992) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 22:14:32 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] deallocate_for_instance() {{(pid=72992) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 22:14:33 user nova-compute[72992]: DEBUG nova.network.neutron [-] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Updating instance_info_cache with network_info: [] {{(pid=72992) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 22:14:33 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Took 0.87 seconds to deallocate network for instance.
Aug 15 22:14:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:14:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:14:33 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:14:33 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:14:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:14:33 user nova-compute[72992]: INFO nova.scheduler.client.report [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Deleted allocations for instance e5f9a32b-7cac-4b7b-92c0-69de7ee14923
Aug 15 22:14:33 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-c5be3c57-8c2b-4574-8663-8d5b396c798c tempest-SnapshotDataIntegrityTests-686268318 tempest-SnapshotDataIntegrityTests-686268318-project-member] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:14:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a13797f-2982-41f3-b21b-a6ae644756b7 req-7dc324ee-1201-4e2f-b21d-20a40650399b service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:14:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a13797f-2982-41f3-b21b-a6ae644756b7 req-7dc324ee-1201-4e2f-b21d-20a40650399b service nova] Acquiring lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:14:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a13797f-2982-41f3-b21b-a6ae644756b7 req-7dc324ee-1201-4e2f-b21d-20a40650399b service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:14:34 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [req-8a13797f-2982-41f3-b21b-a6ae644756b7 req-7dc324ee-1201-4e2f-b21d-20a40650399b service nova] Lock "e5f9a32b-7cac-4b7b-92c0-69de7ee14923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:14:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a13797f-2982-41f3-b21b-a6ae644756b7 req-7dc324ee-1201-4e2f-b21d-20a40650399b service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] No waiting events found dispatching network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 22:14:34 user nova-compute[72992]: WARNING nova.compute.manager [req-8a13797f-2982-41f3-b21b-a6ae644756b7 req-7dc324ee-1201-4e2f-b21d-20a40650399b service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received unexpected event network-vif-plugged-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 for instance with vm_state deleted and task_state None.
Aug 15 22:14:34 user nova-compute[72992]: DEBUG nova.compute.manager [req-8a13797f-2982-41f3-b21b-a6ae644756b7 req-7dc324ee-1201-4e2f-b21d-20a40650399b service nova] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Received event network-vif-deleted-ba82fe6a-6ff0-4712-a6fc-f2e649a109a1 {{(pid=72992) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 22:14:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:14:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:14:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:47 user nova-compute[72992]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692137672.6280777, e5f9a32b-7cac-4b7b-92c0-69de7ee14923 => Stopped> {{(pid=72992) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 22:14:47 user nova-compute[72992]: INFO nova.compute.manager [-] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] VM Stopped (Lifecycle Event)
Aug 15 22:14:47 user nova-compute[72992]: DEBUG nova.compute.manager [None req-15621191-3a79-4ef6-8b6d-00ff6c4fba87 None None] [instance: e5f9a32b-7cac-4b7b-92c0-69de7ee14923] Checking state {{(pid=72992) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 22:14:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:14:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:14:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:14:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:53 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:57 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:14:58 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:14:59 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:15:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:15:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:15:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:15:02 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:03 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:03 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72992) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 22:15:05 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:15:05 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:15:05 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Auditing locally available compute resources for user (node: user) {{(pid=72992) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 22:15:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:15:06 user nova-compute[72992]: WARNING nova.virt.libvirt.driver [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.299076080322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=72992) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72992) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing inventories for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating ProviderTree inventory for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Updating inventory in ProviderTree for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing aggregate associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, aggregates: None {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Refreshing trait associations for resource provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=72992) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.compute.provider_tree [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed in ProviderTree for provider: 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 {{(pid=72992) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.scheduler.client.report [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Inventory has not changed for provider 0ba7034c-2c49-478a-ace5-5ede6ef0ca42 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72992) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG nova.compute.resource_tracker [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Compute_service record updated for user:user {{(pid=72992) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 22:15:06 user nova-compute[72992]: DEBUG oslo_concurrency.lockutils [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=72992) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 22:15:07 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:07 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:10 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:11 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Starting heal instance info cache {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 22:15:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Rebuilding the list of instances to heal {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 22:15:11 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Didn't find any instances for network info cache update. {{(pid=72992) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 22:15:12 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:15:16 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 22:15:16 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] There are 0 instances to clean {{(pid=72992) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 22:15:17 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:15:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:22 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:26 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:27 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:27 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:29 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:31 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:31 user nova-compute[72992]: DEBUG nova.compute.manager [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72992) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 22:15:32 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:37 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:15:42 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:15:45 user nova-compute[72992]: DEBUG oslo_service.periodic_task [None req-aefe269b-9201-4cba-b617-23f75a1f340f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72992) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 22:15:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:15:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:15:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:15:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:15:47 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 22:15:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 22:15:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72992) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 22:15:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:15:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72992) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 22:15:52 user nova-compute[72992]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=72992) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}